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ABSTRACT 

A Study investigated the relationship becween 
avionics subsystem design characteristics and training time, training 
cost, and job performance. A list of design variables believed to 
affect training and job performance was established and supplemented 
with personnel variables, including aptitude test scores and the 
amount of training and experience. Thirty functional loops from ten 
avionics subsystems were selected as the units of equipment to be 
investigated. Ten students were observed performing each of the 
functional checkouts. Training time and training equipment cost data 
were collected for each loop* A factor analysis identified six 
factors which account for a major part of the variance in maintenance 
task performance: length of checkout procedure, equipment complexity, 
difficulty of checkout steps, nonautomatic checkout, diagnostic 
information, and clarity of information. The magnitude of the 
regression coeffients (.92 or better) establish this as a promising 
approach to deriving human resources data for systems under 
development. Additional research is needed to develop and quantify 
better hardware and personnel variables. (JK) 
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ABSTRACT 



The relationships between subsystem design characteristics, training cost, 
training difficulty, and job performance were investigated for avionics sub- 
systems. A list of relevant design characteristics was established, based 
on expert opinions of avionics engineers. Air Force (AF) training supervisors, 
and AF instructors. Functional loops were selected from 10 subsystems repre- 
senting navigation, flight control, coiimuni cat ions, and fire control subsys- 
tems. Performance tests for each of the 30 functional loops were identified 
or constructed. Ten AF students performed each of the tests. Time and errors 
were recorded for using equipment and reading technical orders (T.O.'s). Both 
stepwise regressions and factor analysis were used to derive equations to 
predict performance time, training time, T.O. time, errors, and training equip- 
ment cost from equipment design characteristics, personnel characteristics, 
and environmental variables. Multiple correlation coefficients were 0.88 or 
greater. Factors of Length of Checkout Procedure, Equipment Complexity, 
Difficulty of Checkout Steps, Nonautomatic Checkout, Diagnostic Information, 
and Clarity of Information were identified. Applications of these equations 
should, for the present, be made cautiously, particularly if any of the input 
data fall outside the ranges which entered into derivation of the equations. 
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SUMMARY AND CONCLUSIONS 



1 . PROBLEM 

The human resources of the Air Force have a major impact on the operational 
capabilities and overall costs of systems. However, information on human resources 
requirements is generally introduced late or not at all into system design. Pre- 
vious studies by the Air Force Human Resources Laboratory indicate such informa- 
tion does affect design if it is available in suitable quantitative form early 
in design and if the Statement of Work requires that it be used. This study 
investigated the relationship between avionics subsystem design characteristics 
and training time, training cost, and job performance. 

2. APPROACH 

A list of design variables believed to affect training and job performance 
was established, and supplemented with personnel variables. Twenty-nine mea- 
sures of the equipment design were taken, ranging from the number of test points 
to the number of throw-away components. The personnel variables used were apti- 
tude test scores, and amount of training and experience. Thirty functional loops, 
from ten avionics subsystems, were selected as the units of equipment to be investi- 
gated. A functional loop is defined as a neti^ork of circuits and equipment units 
within an avionics subsystem through which signals are processed to perform a 
specific function. Functional checkout procedures were identified or constructed 
for each functional loop. Ten Air Force (AF) students were observed performing 
each of the functional checkouts; performance time. Technical Order (T.O.) reading 
time, and errors were recorded. Training time and training equipment cost data 
were collected for each loop. Regression analyses and factor analysis were used 
to analyze the results and derive equations to predict training time, training 
equipment cost, and job performance time and errors from equipment characteristics. 

3. RESULTS AND CONCLUSIONS 

Four prediction equations were developed through the use of stepwise regres- 
sions. It was found that 94 percent of the variance in maintenance task performance 
time can be accounted for by the complexity of the subsystem, the number of steps 
in the maintenance task, the reliability of the test equipment used, and the rug- 
gedness of the components being repaired. Ninety-four percent of the variance irf 
task errors was found to be due to the number of steps in the maintenance task, 
the number of special conditions, such as cooling, that are required, extent to 
which the T.O. uses standard symbol ogy, the amount of training, the number of depen- 
dent remotely located components, and the reliability of the test equipment. 
Eight-one percent of the variance in training time required for a task could be 
accounted for by the convenience of test point location, the length of the task, 
T.O. change data are clearly presented and the number of dependent remotely located 
components. The last equation showed that 77 perctnt of the variance in the cost 
of training equipment could be accounted for by the extent to which maintenance 
tasks are automated, the percent of identical circuits used and the T.O. time. 



A factor analysis, using the orthogonal components methods, resulted in 
identifying 6 factors which account for a major part of the variance in the 20 
independent variables which correlate significantly with performance. Names 
assigned to the 6 factors are: Length of Checkout Procedure; Equipment Com- 
plexity; Difficulty of Checkout Steps; Nonautomatic Checkout; Diagnostic Informa- 
tion; and Clarity of Information. Stepwise regressions of the performance vari- 
ables on the factors resulted in prediction equations with multiple correlation 
coefficients of 0.92. or greater. 

The magnitudes of the regression coefficients establish this as a very promis- 
ing approach to deriving human resources data for systems under development. This 
has been shown to be true across a variety of avionics equipment, including com- 
munications sets, autopilots, air data computers, and fire control systems. The 
degree of predictive accuracy attained in this study cannot be expected to remain 
as high during replications of this study. However, the results of this study 
indicate that even with normal shrinkage, the predictive capability of the equa- 
tions will remain highly significant. 

4. DIRECTIONS FOR FUTURE RESEARCH AND APPLICATION 

Additional research is needed to develop and quantify better hardware and 
personnel variables. When this has been accomplished, data need to be collected 
across a broader spectrum of avionics equipment design and maintenance tasks, 
in order to extend the general i zabi 1 ity of the prediction equations. Finally, 
predictions need to be based upon these equations, and these predictions tested 
against real-world observations. The prediction equations once validated should 
be used to generate quantitative forecasts of training and performance parameters 
for avionics systems during the design process. The predicted parameters should 
be compared with the results from current methods for predicting training and 
performance and the results should be documented to the AF to provide data for 
assessing the relative utilities and validities of the different methods. 
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SECTION 1 
INTRODUCTION 



1 . NATURE OF THE PROBLEM 

The human resources of the Air Force account for a large part of systems 
costs and have a major impact on operational capabilities. However, 
human resources considerations are usually introduced late or not at all 
in system design. Consequently, the product which enters the AF inventory 
is often designed to provide the required operational capability at 
minimum initial cost. The design process and the data introduced into it 
often do not operate to minimize such important factors in life cycle cost 
as pay, allowances, and support for the necessary maintenance personnel, or 
the costs of training these people. If better methods are developed and 
implemented for predicting human resources costs during system design, 
then the design process can trade off system capability, equipment cost, 
and human resources costs to achieve an optimal product. That human 
resources consideration*; constitute an acute problem is clear from a 
recent Pentagon forecast (Aviation Week, 21 August 1972, p. 11) of a 
$112 billion defense budget in 1980, an increase of almost 35 percent 
over the current $83 billion budget. This forecast was accompanied by 
the caution that the 35 percent increase would represent no increase 
in purchasing power over the current budget because of inflation and 
because of rising manpower costs. 

The currently available methods for predicting human resources costs from 
equipment design characteristics leave much to be desired. Frequently, 
only "best guess" data from someone familiar with AF personnel skills and 
operations can be provided. Objective methods of forecasting human 
resources requirements during the course of system design are needed. 
This study explored some possibilities for sharpening the precision of 
the data and for moving toward objectivity. 

Smith and Westland (1971) reviewed the status of maintainability models. 
They concluded that the correlational approach to predicting maintaina- 
bility appears to be "the only possible empirical approach for use in 
early design, short of simply providing subjective estimates." They 
stress the importance of a relevant and inclusive list of equipment 
characteristics, and the necessity for a valid data base. Topmiller 
(1964) pointed out the need for sampling across different classes of 
equipment, in order that the resulting predictive scheme can be general- 
ized sufficiently to be of practical use. 

The principle requirements for a correlational study of equipment char- 
acteristics influencing maintainability can be summarized: 

(1) establish a comprehensive and valid listing of design characteris- 
tics for inclusion in the study; 

(2) sample across classes of equipment so that the results of the study 
can be generalized to a range of practical equipment items; and 
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(3) collect as comprehensive a data bace as possible using the uest 
methods available. 

2. GENERAL APPROACH 

The general approach for this st ^ ^signed with the three criteria 
listed above in mind. To meet t. d cost limitations in this initial 
probe, restrictions had to be imposed but these were chosen to maximize 
the data base and the general izability. The items of equipment which were 
investigated were .30 functional loops within 10 different avionics sub- 
systems including navigation, flight control, communications, and fire 
control. A functional loop is defined as a network of circuits and 
equipment units within an avionics subsystem through which signals are 
processed to perform a specific function. 

The data base consisted of on-site real-time observations of performance 
by experienced data collectors. There were no existing data bases 
applicable to the training situation. The possibility of drawing on 
expert opinion for ratinqs of task times and errors was considered, but as 
Smith and Westland (1971) concluded, "the basic problem associated with 
subjective techniques for acquiring performance data is simply that they 
have not been explored and evaluated to any significant degree." Meister, 
Finley, and Thompson (1971) included subjective measures in their study 
of maintenance performance, but were unable to obtain direct observation 
data on enough ^^ses to establish validity. Thus far, the most satis- 
factory method of collecting maintenance performance data is observation 
by observers who are familiar with the tasks they are scoring. 

The major compromise which was utilized in this study to hold data 
collection to manageable proportions was in the selection of tasks to 
be observed. Ideally, all tasks or a broad sample of tasks on each 
functional loop should be investigated. This would include sampling all 
of the possible troubles and malfunctions that can occur. The compromise 
was to choose a task which could be specified for each functional loop, 
and which, if carried through without error, would indicate unambiguously 
that the functional loop was or was not operating and within specified 
tolerances. This task was the functional checkout procedure, and its 
attractiveness for this study's purpos3S lies in the facts that a com- 
plete functional checkout can be specified for each functional loop of 
avionics equipment, and that the functional checkout is the first stage 
of troubleshooting. The checkout verifies that the reported malfunction 
is indeed present, that it is in the loop under investigation, and within 
that loop identifies the area of malfunction. 

The primary interest of this study was in training, and in job performance 
by students in the training environment. All observations of performance 
were carried out in the technical schools at Chanute, Keesler, and Lowry 
AFBs. The study was carried out in three broad phases: first, determine 
the design characteristics to be included, and select subsystems and 
functional loops to represent those characteristics; second, collect 
data; and third, analyze results. 
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SECTION II 
PROCEDURE 



1. ESTABLISH LIST OF DESIGN CHARACTERISTICS 

The first task was to establish a list of design characteristics of 
avionics equipment which were believed to affect maintenance training. 
This was a two-stage process in which a number of sources were surveyed 
to generate an extensive list of characteristics, and this 'extensive 
list was ordered and reduced in conformity with expert ratings. 

The design characteristics listed by Meister, Finley, and Thompson (1970) 
were taken as a starting point for the extensive list. The AF Design 
Handbooks, especially DH 1-8 and DH 1-9, were searched for additional 
likely characteristics. Further suggested characteristics which influ- 
ence training were obtained from personnel of the Training Research 
Applications Branch (TTOE) and the Avionics Training Departments at 
Chanute, Keesler, and Lowry AFBs. Finally, the McDonnell Douglas Corpor- 
ation (MDC) avionics engineering personnel sorted the list, eliminated 
obvious redundancies, and suggested additional design characteristics 
which might affect training, The end result of this effort was a list 
of 49 design characteristics. This listing was prepared in six different 
presentation orders, for use in the subsequent interviews. 

2. ESTABLISH RELATIVE IMPORTANCE OF DESIGN CHARACTERISTICS 

In order to establish the relative importance of the 49 design character- 
istics in determining the amount of training for maintenance personnel, 
individual interviews were conducted with 37 AF instructors and 11 AF 
students at Chanute, Keesler, and Lowry AFBs. The interview sample was 
as shown in Table I. Only avionics instructors and students with previous 
AF maintenance experience were interviewed. Lowry had, at the time of the 
interviews, no studenta with previous AF avionics experience. Conse- 
quently, only instructors were interviewed there. 



TABLE I 
MAKEUP OF INTERVIEW SAMPLE 





CHANUTE 


KEESLER 


LOWRY 


TOTALS 


INSTRUCTORS 


13 


8 


16 


37 


STUDENTS 


3 


8 


0 


il 


TOTALS 


16 


16 


16 


48 



The data collected during these interviews were scaled using the method 
developed by Jones and Dubois (1955). Each interviewee was presented 
with 1 of the 6 orderings of the 49 design characteristics and asked to 
mark the 12 which had the most influence on amount of training with 
and the 12 which had the least influence wUh The remaining 25 

unmarked characteristics represented a middle range, neither the strong- 
est nor the weakest in their effects on training. Items marked 
received a score of 2; items unmarked, 1; and items marked received 
0. Maximum possible score for an item was 96, if all 48 interviewees 
assigned it a "+". Minimum possible was 0, if all interviewees assigned 
it a The complete listing of design characteristics and the results 

of this scaling operation are shown in Table II. It was decided that the 
20 lowest-rated variables would be eliminated from further consideration 
in this study. Because the study dealt with organizational level main- 
tenance, 2 of the first 31 variables were not applicable: T.O. specifies 
open loop measurements; and number of steps required In troubleshooting. 
The remaining 29 variables made up the listing used throughout the subse- 
quent tasks. 

3. SELECTION OF SUBSYSTEMS AND FUNCTIONAL LOOPS 

The final task in this phase of the research was to match the selected 
characteristics with subsystems. The top 15 ranking design characteris- 
tics were used to identify subsystems which represented the widest 
practicable range of values across these design dimensions. The review 
for candidate subsystems combined the expert opinions of 10 Air Training 
Command instructors and 7 MDC Product Service Training instructors with 
broad experience in a number of subsystems. The experience background 
of these subjects is presented in Table III. 



TABLE III 

EXPERIENCE OF SUBJECTS USED IN SUBSYSTEM SELECTION 



SUBJECTS 


YEARS OF TECHNICAL EXPERIENCE 
IN ELECTRONICS 


RANGE 


MEAN 


lOATC INSTRUCTORS 


L1-2L5 


12.3 


7 IN-HOUSE PRODUCT SERVICE 


10.0-21.0 


15.7 


INSTRUCTORS 







TABLE 1 1 

LIST OF DESIGN CHARACTERISTICS, AND THEIR RELATIVE IMPORTANCE 
TO TRAINING AS RATED BY AF INSTRUCTORS AND STUDENTS 



DESIGN CHARACTERISTIC 


RATING 


T 0 CHECKOUT AND TROUBLESHOOTING INFORMATION IS COMPLETE 


82 


T 0 USES STANDARD SYMBOLOGY TO FULLEST EXTENT. AND EXPLAINS NON STANDARD SYMBOLOGY 


72 


CHECKOUT PROCEDURE REQUIRES FEW STEPS (VS fl^ANY STEPS) 


68 


ONLY ONE PIECE OF TEST EQUIPMENT IS NEEDED (VS SEVERAL OR MANY) 


66 


T.O SPECIFIES TOLERANCES FOR ALL MEASUREMENTS 


65 


TEST POINTS ARE CONVENIENTLY LOCATED FOR EACH MODULE 


6b 


T.O SECTIONS ARE IN LOGICAL SEQUENCE 


65 


CHECKOUT OF UNITS DOES NOT DEPEND ON OTHER SYSTEMS OR REMOTELY LOCATED COMPONENTS. 


61 


T.O PROVIDES QUANTITATIVE INFORMATION (VS GO - NO GO) 


61 


PLUG-IN CIRCUITS ARE USED (VS HARD WIRED CIRCUITS) 


60 


TROUBLESHOOTING REQUIRES FEW STEPS iVS MANY STEPS) 


60 


CONTROLS ARE CLEARLY IDENTIFIED 


59 


COMPONENTS ARE EASILY ACCESSIBLE FOR TESTING AND REK'OVAL 


59 


MANY TEST POINTS ARE PROVIDED 


58 


IDENTICAL CIRCUITS ARE USED REPEATEDLY 


58 


CONNECTORS CANNOT BE INCORRECTLY CONNECTED 


58 


MANY ADJUSTMENTS ARE REQUIRED 


57 


T.O. PRESENTS CHANGE DATA IN A CLEAR AND CONCISE MANNER 


54 


AGE IS VERY RELIABLE. 


52 


SUBSYSTEM CHECKOUT DOES NOT REQUIRE SPECIAL CONDITIONS (COOLING. TEMPERATURE CONTROL. 


51 


HYDRAULICS, SPECIAL VOLTAGES) 




AGE OPERATION IS COMPLEX. 


50 


COMPONENTS CAN STAND REPEATED ADJUSTMENTS 


49 


BIT IS USED (VS CART AGE VS BENCH INSTRUMENTS) 


49 


T.O. SPECIFIES OPEN-LOOP MEASUREMENTS 


48 


AUTOMATIC CHECK OUT IS USED (VS NON-AUTOMATIC) 


47 


THE AGE GIVES QUANTITATIVE READINGS (VS GO - NO GO^ 


47 


SYSTEM CONTROLS ARE CONVENIENTLY LOCATED RELATIVE TO AGE CONTROLS. 


46 


CHECKOUT PROCEDURE IS DOWN TO THE LOWEST LRU (VS DOWN TO MODULE LEVEL). 


46 


UNITS ARE EASILY REMOVED FROM THE SYSTEM, 


45 


ARRANGEMENT OF TEST POINTS OF FOLLOWS T 0 SEQUENCE 


45 


CONNECTORS ARE READILY ACCESSIBLE 


44 


IT'S ANn LSI ARF IKFD (VS DISPRFTF COMPONENTS^ 


43 


MULTIPLEX IS USED (VS INDIVIDUAL SIGNAL WIRING). 


41 


CIRCUITS ARE NOT SUSCEPTIBLE TO NOISE AND EM RADIATION. 


41 


ALL CIRCUITS ARE ANALOG (VS DIGITAL OR HYBRID) 


40 


WORKING POSITION AND LIGHTING ARE CONVENIENT FOR EACH UNIT 


40 


EACH UNIT HAS FEW COMPONENTS (VS MANY COMPONENTS). 


39 


COMPONENTS ARE ARRANGED LOGICALLY WITHIN UNITS. 


36 


AGE IS OF CONVENIENT, MANAGEABLE SIZE. 


34 


THROW-AWAY COMPONENTS ARE USED (VS REPAIRABLE COMPONENTS). 


33 


MEMORY STORAGE IS IN FLIPFLOPS(VS MAGNETIC CORE, MAGNETIC TAPE. OR OTHER). 


32 


GOOD TYPES OF CONNECTORS ARE USED (SOLDER VS CRIMP, POTTED VS NON-POHED. 


32 


SCREW-ON VS QUICK CONNECT, ETC.) 




SIZES OF UNITS ARE CONVENIENT AND MANAGEABLE 


32 


NUMBER OF CONNECTORS IS MINIMIZED. 


31 


CLEAN COMPONENTS ARE USED (VS POHED, COATED, OR SEALED COMPONENTS), 


31 


DISPLAYS ARE ANALOG (VS DIGITAL). 


29 


DISPLAYS ARE ELECTROMECHANICAL (VS CRT OR OTHER). 


28 


STANDARD SIZE COMPONENTS ARE USED (VS MICRO-MINIATURE). 


26 


WEIGHTS OF UNITS ARE MANAGEABLE AND CONVENIENT. 


25 
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The criteria for subsystem selection were: 

(1) The subsystem should consist of airborne electronics equipment, 

(2) The subsystem should be pairable with another subsystem on the 
basis of functional similarity. 

(3) The paired subsystems should reflect different proportions of 
the design characteristics under study, to provide meaningful 
comparisons. 

(4) The subsystem should not contain sensitive data in those areas 
where this study would impinge. 

(5) The subsystem should be taught at Lowry, Keesler, or Chanute 
Technical Training Center. 

On the basis of the above criteria, 16 subsystems were chosen and 
analyzed further by applying 2 other criteria: 

(6) The functional loops selected should be those in which there 
was a reasonable amount of maintenance performance activities. 

(7) The course of instruction for the selected functional loop 
should include hands-on practice as a learning objective. 

Since the study was concerned with student interaction with hardware 
design features, criterion (7) served to establish the existence of a 
student population with some training in practical performance, while 
criterion (6) served to single out the best functional loops for 
meaningful coverage of a subsystem. 

The final selection consisted of the 10 subsystems and 30 functional 
loops listed in Table IV. Information on the functions of these subsystems 
is also provided in Table IV. Four of the subsystems, the APQ-120, APQ-109, 
and ASG-19 Fire Control Systems and the ASN-91 Tactical Computer, used 
in the F4E, F4D, F105, and A7D fighter aircraft, respectively, were taught 
at Lowry AFB-Denver, Colorado.' Threee others, the Fill Central Air Data 
Computer, the Fill Automatic Flight Control System, and the MB-5 Automatic 
Flight Control System used in the FlOl, were taught at Chanute AFB-Rantoul , 
Illinois. The remaining three, the ASN-48 Inertial Navigation System and 
the ARC-34 and ARC-51 UHF Communications Systems used in the F4C, C-130, 
and OV-10, respectively, were taught at Keesler AFB-Biloxi, Mississippi. 
Since three bases were involved, the location of the school was included 
as a variable in the study. 

4. QUANTIFICATION OF HARDWARE DESIGN VARIABLES 

Two methods were used in scaling the design characteristics. The most 
direct approach was to effect a physical count such as number of test 
points. This was possible on 14 of the design characteristics. For the 
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TABLE IV 

AVIONICS SUBSYSTcMS AND FUNCTIONAL LOOPS INVESTIGATED IN THE STUDY 



SUBSYSTEM AND FUNCTION DESCRIPTION 


FUNCTIONAL LOOPS 


APQ-120 FIRE CONTROL SYSTEM 

SEARCHES FOR, ACQUIRES, AND AUTOMATICALLY TRACKS AN AIRBORNE 
TARGET. THE CAPABILHY ALSO EXISTS OF DETERMINING RANGE TO A 
GROUND TARGET. 


TRANSMIHER 

ELECTRICAL FREQUENCY CONTROL 
ASE (ALLOWABLE STEERING ERROR) 
AIM DOT 

CW ILLUMINATOR 


APO-109 FIRE CONTROL SYSTEM 

SEARCHES FOR AND ACQUIRES AN AIRBORNE TARGET. TRACKS THE TAR 
GET AUTOMATICALLY AND SUPPLIES TARGET POSITION INFORMATION TO 

THP TARHPT INTPRPPPT mMPIITPQ AND i<VinirATnP^ 


TRANSMIHER 

ELECTRICAL FREQUENCY CONTROL 
ASF (ALLOWABLE STEERING ERROR) 
AIM DOT 


ASG-19 RADAR 

PROVIDES AIR TO AIR SEARCH. TARGET ACQUISITION. TERRAIN AVOID- 
AMPP AMn AID Yn PDniiMn DAiiriiir MAnpc np npPRATinii it ai 

PROVIDES RANGE INFORMATION TO THE TOSS BOMB COMPUTER AND THE 
ATTACK AND DISPLAY SUBSYSTEM. 


TRANSMIHER 

FL FCTRICAL FREQUENCY CONTROL 
ON-TARGET STEERING 


ASN-91 TACTICAL COMPUTER 

rROuEdSEd UAI A FROM INTEKFACED AmrLAKE dYdTclnb lU UtnlVt 
COMPUTED AUTOMATIC NAVIGATION AND WEAPON DELIVERY CONTROL 
AND DISPLAY DATA. 


PNTIRP ^V^PH 


ASN-48 INERTIAL NAVIGATION SYSTEM 

COMPUTES INFORMATION REGARDING AIRCRAFT LATITUDE. LONGITUDE. 

upAniiir DiTPu Aiin Dm i tup rnuDiiTcn niiTDiiTC ADP ciiDDi ipn Tn 
ntAUINb. rl 1 Un AND KULL. 1 nt UUmrU 1 tU UU 1 rU 1 d Ant dUrrLItU 1 U 

AIRCRAFT AVIONICS EQUIPMENT. 


PLATFORM ALIGNM:NT 

NAl/IHATinN 


ARC-51 UHF COMVIUNICATIONS 

PROVIDES 2 WAY AMPLITUDE-MODULATION. DOUBLE-SIDEBAND. FULL 
CARRIER. RADIOTELEPHONE COMMUNICATION BETWEEN AIRCRAFT IN 

Cl irUT AIDPDArT Aiin CUADP AMn AIDPDACT Alin CUIP 

rLlbn 1 . AIKUKAP 1 AND onUltt. ANi/ AlltUttAr 1 ANU onlr. 


TRANSMIHER 
MAIN RECEIVER 

TUNINH 
1 uninu 


ARC-34 UHF COMMUNICATIONS 

PROVIDES SHORT-RANGE VOICE TRANSMISSION AND RECEPTION FROM 
AIRCRAFT TO AIRCRAFT OR AIRCRAFT TO GROUND. 


TRANSMIHER 
MAIN RECEIVER 
TUNING 


Fill AUTOMATIC FLIGHT CONTROL SYSTEM 

PROVIDES AUTOMATIC CONTROL OF THE AIRCRAFT IN THE YAW. ROLL 
AND PITCH AXES. SEVERAL MODES OF OPERATION ARE PROVIDED WHICH 
THE PILOT MAY SELECT TO RELIEVE THE BURDEN OF FLYING THE AIR- 
CRAFT OR TO ACCOMPLISH A WEAPONS DELIVERY MISSION. 


PITCH 
ROLL 
YAW 


FlOl AUTOMATIC FLIGHT CONTROL SYSTEM 

PROVIDES AUTOMATIC CONTROL OF THE AIRCRAFT IN THE YAW. ROLL 
AND PITCH AXES. SEVERAL MODES OF OPERATION ARE PROVIDED WHICH 
THE PILOT MAY SELECT TO RELIEVE ^HE BURDEN OF FLYING THE AIR- 
CRAFT OR TO ACCOMPLISH A WEAPC^« DELIVERY MISSION. 


PITCH 
ROLL 
YAW 


Fill CENTRAL AIR DATA COMPUTER 

RECEIVES. COMPUTES. TRANSMITS AND DISPLAYS INFORMATION CONCERN- 
ING THE ENVIRONMENT IN WHICH THE AIRCRAFT IS FLYING. THE COM- 
PUTED INFORMATION IS USED BY SYSTEMS REQUIRING AIR DATA FUNC- 
TIONS ESSENTIAL TO THEIR PROPER OPERATION. 


MACH 
ALTITUDE 
TRUE AIRSPEED 



remaining design variables, a direct count was not possible and values 
were derived from a judgment survey. Examples of variables scaled in 
this way are "T.O. sections are in logical sequence" and "Components 
can stand repeated adjustment." 

The judgment survey for scaling design variables was administered to 82 
ATC instructors, supervisors, and course writers. From 5 to 14 raters 
were used for each subsystem, with ratings by any one rater limited to 
3 functional loops which were presented in a counterbalanced order. 
Rating scales with scale divisions numbered 0 to 10 were constructed. 
For each design characteristic to be scaled, definitions were given to 
the 0 and the 10 on the scale. In scaling "T.O. sections are in logical 
sequence," for example, 0 was defined as "None of the T.O. sections for 
this functional loop are in logical sequence" and 10 was defined as 
"100 percent of the T.O. sections for this loop are in logical sequence." 

Instructions emphasized that the ratings should apply exclusively to 
the functional loop identified on the rating form. By defining the 
scale values In terms of percentages, it was felt that the rater could 
effect a proportionality assessment to arrive at a value, such as "Of all 
the T.O. sections that are applicable to this loop, 85 percent are in 
logical sequence." The characteristics of the raters are described in 
Table V. The values for all design variables used in the study are 
summarized in Table VI and listed fully in Table XVI, The values given 
in Table XVI for variables scaled by the judgment survey represent means 
of the values assigned by all raters on a functional loop. 



TABLE V 

CHARACTERISTICS OF THE RATERS ON THE SCALING SURVEY 



SUBSYSTEM 


NUMBER OF RATERS 


AVERAGE EXPERIENCE 
IN AVIONICS (YEARS) 


Fin CADC 


5 


2.4 


FlOl ARCS 


5 


13.. 


nil AFCS 


5 


m 


ASN-48 INS 


5 


9.1 


ARC-34 UHF 


14 


9.0 


ARC-51 UHF 


12 


8.1 


APQ-120 FCS 


12 


14.6 


APQ-)09 FCS 


14 


10.5 


ASG-19 RADAR 


5 


6.8 


ASN-91 COMPUTER 


5 


8.0 
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TABLE VI 

LISTING OF ALL VARIABLES, WITH RANGES, MEANS, AND STANDARD DEVIATIONS 



VARIABLE 
NUMBER 


UCobnlr 1 lun ur VAnlADLL 


RANGE 


MUUf 


STANOARO 
DEVIATION 


1 


AQE ELECTRONICS SCORE 


85.0- 93.5 


88.50 


2.74 


2 


PAST EXPERIENCE (MONTHS) 


0 - 6.5 


1.68 


2.14 


3 


PAST TRAINING (MONTHS) 


0 - 6.0 


1.38 


1.75 


4 


PERFORMANCE TMIE (SECONOS) 


249 -4385 


1714 


1365 


S 


T.O. TIME (SECONOS) 


31.1-2419.7 


585 


571 


6 


NUMBER OF ERRORS 


0.5- 16.8 


6.56 


5.20 


7 


TRAINING TIME (HOURS) 


2.0- 122.0 


41.05 


32.45 


8 


. CHANUTE (AT CHANUTE= 1. NOT CHANUTE = 0) 




0.30 


0.47 


9 


KEESLER (AT KEESLER^ 1, NOT KEESLER= 0) 


_ 


0.27 


0.45 


10 


LOWRY (AT LOWRY= 1. NOT LOWRY= 0) 


_ 


0.43 


0.50 


11 


COMPLETENESS OF T.O. CHECKOUT INFORMATION 


7.0- 10.0 


9.20 


0.73 




(RATING ONIO-POINT SCALE) 








12 


EXTENT TO WHICH T.O. USES STANOARO SYM80L0GY 


2.8- 9.7 


8.66 


1.68 




(10-POlNT RATING SCALE) 








13 


NUMBER OF STEPS IN CHECKOUT PROCEDURE 


41 - 787 


285.97 


219.21 


14 


NUMBER OF PIECES OF TEST EQUIPMENT NEEDED 


0 - 3 


1.27 


1.08 


IS 


PERCENTAGE OF MEASUREMENTS FDR WHICH T.O. 


0 - 100 


59.57 


30.22 




SPECIFIES TOLERANCES 








16 


TEST POINTS ARE CONVENIENT (ID-POINT RATING SCALE) 


4.2- 10 


8.28 


1.71 


17 


T.O. SECTIONS ARE IN LOGICAL SEQUENCE (lO-POINT 


6.0- 10.0 


8.74 


1.01 




RATING SCALE) 








18 


NUMBER OF OTHER UNITS REQUIRED FDR CHECKOUT 


1 - 9 


2.37 


1.63 


19 


PERCENTAGE OF MEASUREMENTS WHICH ARE SPECIFIED 


0 - 100 


36.27 


32.02 




QUANTITATIVELY IN THE T.O. (VS GO-NO GO) 








20 


PERCENTAGE OF PLUG-IN CIRCUITS (VS HARDWIRED) 


0 - 100 


68.72 


28.33 


21 


NUMBER OF STEPS IN TROUBLE SHOOTING 


N A 


N'A 


N A 


22 


CONTROLS ARE CLEARLY IDENTIFIED (10-POlNT RATING 


4.4- 9.8 


8.73 


1.37 




SCALE) 








23 


ACCESSIBILITY OF COMPONENTS (10-POINT RATING SCALE) 


2.6- 9.9 


736 


1.95 


24 


NUMBER OF TEST POINTS 


0-32 


9.00 


11.77 


2S 


PERCENTAGE OF IDENTICAL CIRCUITS USED 


0-64 


13.27 


23.27 


26 


PERCENTAGE OF CONNECTORS WHICH CAN BE 


0-92 


36.81 


24.96 




INCORRECTLY CONNECTED (RATING SCALE) 








27 


NUMBER OF ADJUSTMENTS REQUIRED 


0 - 11 


2.57 


3.64 


28 


T.D. CHANGE DATA ARE CLEARLY PRESENTED (10-POlNT 


5.0- 10.0 


8.32 


1.44 




RATING SCALE) 








29 


RELIABILITY OF TEST EQUIPMENT (1(W»DINT RATING SCALE) 


5i- 10.0 


8.04 


1.39 


30 


NUMBER OF SPECIAL CONDITIONS REQUIRED FDR CHECKOUT 


0-2 


1.10 


0.96 




(E.G. CODLING. HYDRAUUCS) 








31 


COMPLEXITY OF TEST EQUIPMENT OPERATION (lO-POINT 


4.2- 9.9 


7.25 


1.59 




RATING SCALE) 








32 


COMPONENTS CAN STAND REPEATED ADJUSTMENT (10-POINT 


5.2- 10.0 


8.23 


1.24 




RATING SCALE) 








33 


PERCENTAGE OF CHECKOUT WHICH IS BIT 


0 - 100 


42.97 


45.53 


34 


PERCENTAGE OF CHECKOUT WHICH IS AUTO Jl'iK/ LLY 


0 - 33 


1.93 


7.43 




SEQUENCED 








3S 


PERCENTAGE OF TEST EQUIPMENT READINGS WHICH 


0 - 100 


61.27 


45.29 




ARE QUANTITATIVE 








36 


CONVENIENCE OF LOCATION OF SYSTEM AND TEST EQUIP- 


3.0- 10.0 


7.87 


1.70 




MENT CONTROLS (ID-POINT RATING SCALE) 








37 


PERCENTAGE OF CHECKOUT WHICH IS TO LOWEST LRU 


61 - 100 


96.07 


11.90 


38 


ACCESSIBILITY OF UNITS FDR TESTING AND REMOVAL 


2.8- 9.8 


7.67 


2.12 




(10-POINT RATING SCALE) 








39 


TEST POINT ARRANGEMENT FOLLOWS T.O. SEQUENCE 


3.0- 10.0 


7.95 


1.81 




(10-POINT RATING SCALE) 








4G 


ALTERNATE FDR VARIABLE NO. 31; COUNT OF NUMBER OF 


0 - 115 


35.00 


37.89 




CONTROLS AND DISPLAYS 








41 


ALTERNATE FDR VARIABLE NO. 16' PERCENTAGE OF TEST 


0 - 100 


93.33 


177.98 




POINTS ACCESSIBLE WITHOUT REMOVING UNITS OR COVERS 








42 


PERFORMANCE OBSERVATION WEEK 


4 - 34 


16.53 


8.01 


43 


TEST EQUIPMENT COST. DOLLARS 


27 -1761 


125.77 


311.75 



NOTE' THE NUMBERING OF VARIABLES THROUGHOUT THIS REPORT REFERS TO THIS LIST. 
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5. PERFORMANCE TESTS 



The functional loops served as the baseline for identifying the perfor- 
mance tests to be used in the study. The Plans of Instruction, Criterion 
Checklists, Study Guides, and Sample Performance Tests, as well as other 
training materials were procured and analyzed for total training content, 
adequacy of existing performance testing, and additional requirements for 
testing. It was found that very few learning objectives were devoted to 
troubleshooting practice or adjustment/alignment activities. Where tests 
did exist, they were deficient in operator interaction and would have 
necessitated full-scale construction of examinations on our part as well 
as special arrangements with the bases to administer. Although some 
tests were specially devised and administered, the data sample was too 
small for these two maintenance categories. Consequently, they were 
excluded from the statistical analysis. The tests on which the major 
effort was expended were the functional checkout p^^ocedures. A complete 
functional checkout procedure was developed for each functional loop. 
This checkout consisted of preparatory tasks such as cable connections 
and test equipment setup; the actual tasks that determined the opera- 
tional status of the equipment, such as switch positions for testing and 
display interpretation; and the final tasks of equipment shutdown. 

The basic checkout procedures were extracted from the Technical Orders. 
Changes were required in many cases to reconfigure the examinations to 
reflect the use of the training hardware in the schools instead of the 
aircraft on the flight-line. Task clusters were broken down into behav- 
ioral steps and numbered in procedural sequence, for scoring purposes 
during test administration. The behavioral steps described the actions 
to be performed and the results, as, for example, "Press T-17 microphone 
button. Results: Power output 8 watts minimum." The specially con- 
structed tests were the functional checkout procedures for the FlOl 
Automatic Flight Control loops, the ARC-51 UHF loops, the ARC-34 UHF 
loops, and the Fill CADC loops, wherein task information from the T.O.'s 
and the training environment were integrated to provide suitable 
examinations for the study. The battery of tests for a complete func- 
tional checkout of a loop ranged from one to six tests per loop. Table 
XIX identifies the tests that were administered for each loop, the line 
replaceable units in the loop, and the test equipment used. 

6. PERFORMANCE MEASURES 

Since the study was designed to investigate the influence of design 
characteristics on student performance as one of the dependent variables, 
the examinations were analyzed into a sequential series of behavioral 
steps as previously discussed. A student's response action in a behav- 
ioral step represented his interaction with the equipment setup which 
incorporated the design characteristics in varying magnitudes. The 
performance measures used in the study were (1) performance time, (2) 
time spent consulting T.O., and (3) errors. 

Performance time was recorded as subscores for task activities, and the 
subscores were added to obtain the total performance time on a test. 
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The task activities for the functional checkout were (1) preparatory 
tasks, (2) functional checkout tasks, and (3) shutdown tasks. The T.O. 
time was recorded under the same conditions, "^he errors were recorded 
for behavioral steps. An error was defined as any deviation from the 
prescribed standard of desired performance, the procedural sequence repre- 
senting the standard. The type of error such as "omitted step," "selected 
wrong control," and "interpreted display incorrectly" was described on 
the data collection form. 

7. PERFORMANCE DATA COLLECTION 

The tests were performed by a total of 191 students - 104 at Lowry, 
47. at Chanute, and 40 at Keesler. The AQE Electronics score, past 
experience in career field, and past training in career field were 
treated as personnel variables. A summary of these variables is included 
in Table VI. 

All students were enrolled in an AF course leading to an Air Force 
Specialty Code (AFSC) skill level of 3. All students were graduating or 
qualified students. A graduating student was one who had successfully 
completed the block of instruction's theory and principle and was ready 
to perform hands-on testing. This occurred near the end of the block, 
and meant that during the observations by the data collectors, the stu- 
dent's performance was also being graded as "passed" or "failed" by the 
class instructor. The qualified students were those who had graduated 
out of the block within a period of 10 training days. It was necessary 
to include this population, since it was not possible to test all the 
students as they were being graduated. 

Three MDC observers collected the performance data. Training for the 
data collectors included practice runs of the tests in-house for those 
subsystems that existed in the contractor's product line and at the 
bases prior to actual administration. Some of these dry r.ns were video- 
taped on the bases and brought back to the company for fur her study. 

Two data recording devices were used. One was an MDC-designed battery- 
operated clipboard timer (Figure 1). Two digital readouts provided 
cumulative time and cumulative frequency readings. The clipboards were 
used by two data collectors who functioned as a team. The data collected 
on these digital readouts were the amount of time spent reading T.O. and 
a frequency count of T.O. usage. The performance times and errors for 
the tasks were recorded by the other observer of the two-man team who 
used eitfier another clipboard of the same design or a stopwatch. To 
ensure that the clipboards were functioning accurately, the data col- 
lectors regularly performed a calibration check against a stopwatch, 
prior to actual use of the equipment. 

The other data recording device was a Rustrak Event Recorder (Figure 2), 
operated from a hand-held switch box on which were installed four 2- 
position toggles, permitting the use of 4 channels. The first three 
channels recorded task time, T.O. time and frequency, and errors. The 
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FIGURE 1 CLIPBOARD USED IN PERFORMANCE OBSERVATIONS 




FIGURE 2 EVENT RECORDER AND OPERATOR'S CONTROL USED IN 
PERFORMANCE OBSERVATIONS 
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fourth channel was used to record downtime tj be subtracted from the 
student's performance time. Downtime events included equipment mal- 
functions and other events not related to the test being observed. The 
event recorder was checked periodically against a stopwatch to ensure 
its accuracy. 

Both data collection teams observed the performance of two students on 
the ASG-19 and two students on the ASN-91 for the purpose of estab- 
lishing interrater reliability. There was exact agreement on number of 
errors (14 across the four performances), and interobserver correlations 
of 0.99 for performance times and 0.98 for T.O. times. The two result- 
ing measures of total performance time differed by less than 1 percent. 

Performance testing was carried out as early as the fourth week of a 
class, and as late as the thirty-fourth week, depending on when in a 
course a particular functional loop was taught. Since there was such a 
wide range in amount of cumulative training up to the test week. Perfor- 
mance Observation Week, defined as number of weeks into the course at 
the time of testing, was included as a variable in the studv (Variable 
Y42, Table XVI). Where testing on a functional loop was performed in 
more pan one block, the Performance Observation Weeks were averaged to 
provide the mean week into the course at test time. The weeks of AF 
technical training received by subjects prior to testing are listed in 
Table VII. The weeks of AF training include the Basic Electronics Course, 
and Performance Observation Weeks include only the advanced course times. 

Student performance was observed between November 1071 and April 1972. 
Preliminary arrangements included a survey of the classroom environ- 
ments where the tests were to be conducted, briefing of appropriate 
personnel as to the purpose of the data collection activity, and general 
instructions to students and classroom instructors. 

The survey of the classroom environments checked on the adequacy of 
observation points for the data collectors. Where the class size or the 
equipment arrangement would have hampered data collection operations, 
special arrangements were made to procure the classroom solely for test 
purposes. The briefing helped to relieve apprehension on the part of 
both instructors and students of being evaluated on a personal basis. 
The general instructions defined test breaks and requested the student 
to verbalize his symptom interpretations, when asked by the data collec- 
tor to do so, since there was often no other way of determining whether 
the student correctly diagnosed the functional state of the system. 

Tests were performed by individual students except when Air Training 
Command policy dictated that a test was a two-man task. Where students 
were performing in pairs, arrangements were made with the instructor 
to have one student do the T.O. reading while the other actually per- 
formed. In such a test situation, the test constituted one set of 
data and the personnel variables were combined and averaged. Where 
multiple tests existed in a functional loop, the performance time, 
T,0. time, and errors represented the totals across all tests, and 
the method of averages was again applied to the personnel variables. 
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TABLE VII 

NUMBER OF WEEKS OF AF TECHNICAL TRAINING RECEIVED BY 
STUDENT BEFORE PERFORMANCE OBSERVATION 



FUNCTIONAL CHECKS 


TECHNICAL TRAINING, WEEKS 


ASN-91 COMPUTER LOOP 


15 


nOl AFCS PITCH LOOP 


21 


nOl AFGS ROLL LOOP 


22 


FlOl AFGS YAW LOOP 


22 


APQ-120 TRANSMinER 


29 


APQ-120 EFC 


29 


APQ-120 CW ILLUMINATOR 


29 


APQ-120 ASE 


29 


APQ-120 AIM DOT 


29 


APQ-109 TRANSMinER 


27 


APQ-109 EFC 


27 


APQ-109 ASE 


27 


APQ-109 AIM DOT 


27 


ARC-51 UHF TRANSMinER 


29 


ARC-51 UHF MAIN RECEIVER 


29 


ARC-51 UHF TUNING 


29 


ARC-34 UHF TRANSMITTER 


20 


ARC-34 UHF MAIN RECEIVER 


20 


ARC-34 UHF TUNING 


20 


A$N-48 NAVIGATION 


34 


ASN-48 PLATFORM 


34 


Rll CADCTAS 


25 


Rll CADC MACH 


25 


nil CADC ALTITUDE 


25 


nil AFGS PITCH 


29 


nil AFCS ROLL 


29 


Rll AFCS YAW 


29 


ASG-19 TRANSMinER 


17 


A3G-19AEFC 


17 


ASG-19 ON-TARGET STEERING 


23 
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The 10 observations required for each cest were handled by one data 
collection team. The overriding factors in this approach were training 
for competence in technical content of the examination, in observation 
skills, and in the use of data collection tools. However, all data 
collectors were knowledgeable on all functional loops in terms of equip- 
ment function, equipment units, and related test equipment. 

8. TRAINING TIME AND EQUIPMENT COST DATA COLLECTION 

The training times for the subsystem loops were obtained by administering 
questionnaires to five course experts in each subsystem. The five course 
experts as a team evaluated their subsystems, and their answers repre- 
sented the consensus of the group. They identified the portions of the 
Plan of Instruction applicable to each of the functional loops and 
estimated the training time given for each loop. The training time repre- 
sented a21 training required for a given loop including theory and 
practice, but excluding basic electronics. The technical experience of 
the raters is described in Table VIII, and Table IX shows the training 
times for each of the functional loops. 

The training equipment costs per student per functional loop are tabulated 
in Table X. The method of computation for these costs is presented in 
Table XI. .^ 



TABLE VIII 

AVIONICS EXPERIENCE OF TRAINING TIME EVALUATORS 



SUBSYSTEM 


DEAN YEARS OF 
AVIONICS EXPERIENCE 


APQ-120 


7.9 


APQ-109 


9.3 


ASG-19 


3.7 


ASN-91 


4.0 


FlOl AFCS 


6.8 


Fill AFCS 


5.5 


Rll CADC 


2.2 


ASN-48 


4.7 


ARC-51 


4.2 


ARC-34 


1.2 



ERIC 
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TABLE IX 

HOURS OF TRAINING AS REPORTED BY EVALUATORS FOR 
EACH FUNCTIONAL LOOP 



SUBSYSTEM 


FUNCTIONAL LOOP 


HOURS OF TRAINING 


APQ-120 


TRANSMITTER 
ELEC FREQ CONTROL 
CW ILLUMINATOR 
ASE CIRCLE 
AIM nriT 


27.5 
22.5 
17.5 
lU 

15 0 


APQ-109 


TRANSMITTER 
ELEC FPEQ CONTROL 
ASE CIRCLE 
AIM DOT 


27 J) 

m 

2.0 

4.0 




TRANSMITTER 
ON-TARGET STEERING 


£U.U 

46.5 


ASN-91 


COMPUTER 


60.5 


ASN-48 


NAVIGATION 
PLATFORM ALIGNMENT 


ICO 
28.0 


ARC-51 


TRANSMITTER 
MAIN RECEIVER 
TUNING 


28.3 
28.1 
27.5 


ARC-34 


TRANSMITTER 
MAIN RECEIVER 
TUNING 


65.3 
64.6 

64.2 


Fill AFCS 


PITCH 
ROLL 
YAW 


122.0 
118.0 
77.0 


GlOl AFCS 


PITCH 
ROLL 
YAW 


82.0 
82J) 
76.0 


Fill CADC 


TRUE AIRSPEED 

MACH 

ALTITUDE 


24.0 
25JI 
28.0 



ERIC 
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TABLE X 

EQUIPMENT COST PER STUDENT PER FUNCTIONAL LOOP 



SUBSYSTEM 


EQUIPMENT COST (DOLLARS)/STUDENT 


Fill AFCS 




PITCH 


120 


ROLL 


120 


YAW 


115 


noi APns 




PITCH 


16 


ROLL 


16 


YAW 


16 


Fill CADC 

1 AAA wnvw 




TRUE AIRSPEED 


47 


MACH 

nvi wii 


47 


ALTITUDE 


48 


ASG-19 FIRE CONTROL 




TRANSMITTER 


53 


FREQUENCY CONTROL 


53 


STEERING 


66 


APQ-IOS FIRE CONTROL 




TRANSMITTER 


:ti 


FREQUENCY CONTROL 


154 


ASE 


12 


AIM DOT 


12 


APQ-120 FIRE CONTROL 




TRANSMITTER 


115 


FREQUENCY CONTROL 


115 


CN ILLUMINATOR 


94 


ASE 


75 


AIM DOT 


75 


ASN-91 




COMPUTER 


1.761 


ASN-48 




NAVIGATION 


106 


ALIGNMENT 


106 


ARC-51 




TRANSMITTER 


106 


RECEIVER 


106 


TUNJNG 


106 


ARC-34 




TRANSMIHER 


27 


MAIN RECEIVER 


27 


TUNING 


27 
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TABLE XI 

STEPS IN COMPUTATION OF EQUIPMENT COST 



1. IDENTIFY EACH ITEM OF EQUIPMENT USED IN TEACHING 
EACH BLOCK. 

2. OBTAIN THE COST Of EACH ITEM. 

3. MULTIPLY THE COST BY THE NUMBER OF UNITS OF EQUIP- 
MENT EMPLOYED. 

4. MULTIPLY THAT NUMBER BY THE PERCENTAGE OF THE 
TOTAL USE OF THAT EQUIPMENT REPRESENTED BY THAT 
BLOCK. 

5. SUM THE EQUIPMENT COST ACROSS BLOCKS TO OBTAIN THE 
COST FOR THE FUNCTIONAL LOOPS. 

6. DIVIDE THAT SUM BY THE TOTAL NUMBER OF STUDENTS 
PROCESSED THROUGH THE COURSE IN A TEN YEAR PERIOD TO 
OBTAIN EQUIPMENT COST/STUDENT. 
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SECTION III 
RESULTS 



1 . SUMMARY 



The means, ranges, and standard deviations for each of the variables 
Included in this study are shown in Table VI. In all subsequent data 
tabulations, the numbering of variables is in accord with the numbering 
in this table. Variables 1 through 3 and 42 are personnel variables; 4 
through 6 are performance measures; 8 through 10 are training locations; 
11 through 41 are design variables; and 7 and 43 are training variables. 
For convenience in associating names with variables (Yi through Y/i-i), 
normalized variables (Z] through Z43), and factors (U] through uj. 
Table XXII is included as a foldout at the end of this report. A listing 
of values for all variables across all functional loops is given in 
Table XVI. Variables 8, 9, and 10 were dichotomous (for example. 
Variable 10 is "1" if taught at Lowry, "0" if not taught at Lowry), and 
are not included in Table XVI. 

Stepwise regression analyses were used to derive prediction equations for 
performance time, errors, training time, and training equipment cost. The 
resulting equations are: 

performance time = 641.97 - 1327.06 Yg + 4.23 Y^^ - 330.40 Y2g + 

354.38 Y22. multiple correlation coefficient (R) = 0.973, standard 

error of estimate (S.E.) = 337.30 seconds; 
number of errors = 11.27 - 0.67 Y^ + 0.36 Y^2 + 0-23 Y^^ - 0.63 Y^g - 

1.48 Y2g - 0.83 Ygp, R = 0.97^, S.E. = 1.31 errors; 
training time = -75.66 - 0.01 Y^ + 9.93 Y^g + 7.85 Y^g + 4.97 Y2g, 

R = 0.9C2, S.E. = 15.08 hours; and 

training equipment cost = 16.39 + 0.18 Y^ - 3.67 Yor + 28.67 Y,- , 

0 CO 34 

R = 0.879, S. E. $156.74. 

The 20 independent variables which correlated significantly with performance 
were entered into a factor analysis using the method of orthogonal compon- 
ents. Six factors which accounted for a major part of the variance in the 
independent variables were identified: U], Length of Checkout Procedure; 
U2, Equipment Complexity, U3, Difficulty of Checkout Steps; U4, Nonautomatic 
Checkout; U5, Diagnostic Information; and U6, Clarity of Information. 
Factor U] weights most heavily on (accounts for more than 20 percent of 
the variance of) variables 2, 10, 11, 13, 15, 18, 19, 24, 30, 33, and 35; 
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Factor U2, on variables 1 , 8, 10, 20, 22, 29, 32, and 36; U3, on 2, 15, 
18, 19, 22, and 33; U4, on 1, 8, 18, 30, and 34; U5, on 24, 35, and 41; 
and U6, on 41. (Refer to foldouc Table XXII for variable names.) 

Subsequent to the factor analysis, stepwise regression analyses were used 
to derive equations for predicting performance time, T.O. time, and errors 
from the factors. The following equations were derived: 

Performance Time = 1714.1 + 1018.9 -393.8 U2 + 204.1 U3 - 550.2 U^, 

R = 0.924, S.E. = 563.6 seconds 
T.O. Time = 585.9 + 443.3 + 83.4 U3 -243.3 + 109.6 Ug, 

R = 0.933, S.E. = 221.9 seconds 
Number of Errors = 6.57 + 4.03 - 0.79 + 1.00 U3 - 1.20 + 0.92 Ug 

• 1.49 Ug, R = 0.926, S.E. = 2.21 errors. 

2. PLOTS OF INDEPENDENT VARIABLES VERSUS DEPENDENT VARIABLES 

Prior to beginning data analyses, each of the independent variables was 
plotted against performance time, against number of errors, against 
training time, and against equipment cost. All plots were inspected for 
evidence of nonlinear relationships between variables, and none of the 
plots presented a compelling picture of nonlinearity. Consequently, a 
conservative approach was adopted, i.e., only linear correlations and 
regressions were run. The magnitudes of the correlation and regression 
coefficients which are subsequently reported might have been increased 
by fitting curvilinear functions to the observed data points. However, 
in the absence of either previously formulated hypotheses or strong 
evidence from the data plots, the parsimonious approach was to assume 
linearity. 

3. CORRELATIONS OF VARIABLES 

Table XII shows the variables which correlate slqnif icaptly with one or 
more of the performance variables. In each case; correTatlons are across 
30 pairs of observations. With the resulting 28 degrees of freedom, a 
correlation of 0.306 is significant at the 0.05 level. A complete 
correlation matrix for all variables is given in Table XVIII. The correla- 
tions of principal interest are of the dependent variables (4, 5, 6, 7, 
and 43) with each of the independent variables. Of the 185 resulting 
correlation coefficients, 64 are significant at the 0.05 level or better. 

4. STEPWISE REGRESSIONS OF THE INDEPENDENT VARIABLES ON DEPENDENT VARIABLES 

Stepwise regressions were run to decermine regression equations predicting 
performance time, errors, training time, and training equipment cost 
from the independent variables. In each regression analysis, an IF level 
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TABLE XI! 

VARIABLES CORRELATING SIGNIFICANTLY WITH ONE OR MORE OF THE 
THREE PERFORMANCE VARIABLES 



VARIABLE NUMBER 
(SEE TABLE XXII 
FOR NAMES) 


PERFORMANCE TIME 


T.O. TIME 


ERRORS 


1 


-0.707 


-0.489 


-0.561 


2 


•I-0.660 


+0.639 


+0.626 


8 


-0.592 


-0.318 


-0.407 


10 


+0.597 


+0.699 


+0.657 


11 


+0.325 


+0.388 


+0.355 


13 


+0.786 


+0.869 


+0.876 


15 


-0.344 


-0.445 


-4).476 


18 


+0.385 


+0.606 


(+0.296) 


19 


(-0.185) 


(-0.30^ 


(-0.281) 


20 


(+0.083) 


+0.329 


(+0.164) 


22 


(+0.120) 


(+0.285) 


+0,313 


24 


+0.438 


+0.395 


+0.598 


29 


-0.349 


(+0.025) 


(-0.210) 


30 


+0.414 


+0.349 


+0.416 


32 


(+0.088) 


+0.309 


(+0.098) 


33 


+0.336 


+0.376 


+0.401 


34 


+0.312 


+0.486 


(+0.189) 


35 


(-0.295) 


-0.322 


-0.313 


36 


-0.399 


(-0.225) 


-0.326 


41 


(+0.260) 


(+0.135) 


+0.317 



NOTE: 

NONSIGNIFICANT CORRELATIONS ARE IN PARENTHESES. 
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of 4.18 for inclusion and 3.00 for deletion was set, with a tolerance 
level of 0.50 (an explanation of tolerance level is included as Appendix 
II). 

For performance time, the resulting equation is: 

Perfonnance time (seconds) = 641.97 - 1327.06 Yg + 4.23 - 
330.40 y^g + 354.38 Y32 

This results in a multiple correlation coefficient (R) of 0.973 and a 
standard error of estimate (S.E.) of 337.30 seconds. 

For errors, the equation is: 

number of errors = 11.27 - 0.67 Y3 + 0.36 Y^2 + 0-23 Y^g - 0.63 Y^g - 

1.48 Y2g - 0.83 Y3Q, R = 0.974, S.E. = 1.31 errors. 

For training time, the equation is: 

training time = -75.66 - 0.01 Y^ + 9.93 Y^g + 7.85 Y^g + 4.97 Y28, 

R = 0.902, S.E. = 15.08 hours. 

For training equipment cost, the equation is: 

training equipment cost = 16.39 + 0.18 Y^ -3.67 Y25 + 28.67 Y3^, 

R = 0.879, S.E. = $156.74. 

Analyses of variance were run to determine the significance of each of 
these regression equations. In the "worst case," training equipment 
cost, an F ratio of 4.64 is required for the 0.01 level of significance 
and the actual F ratio is 29.67. The F ratios for the other equations 
range upward to 109.6 (for number of errors). 

5. ORTHOGONAL COMPONENTS 

As an alternative analysis to the stepwise regressions reported above, a 
factor analysis was run to determine orthogonal components. Where the 
stepwise regression brings in variables until no one of the remaining 
variables accounts for enough of the residual variance (with "enough" 
defined by the specified f to enter and tolerance level), the orthogonal 
components analysis retains information about all the variables which 
are entered into the analysis. Subsequent to the orthogonal components 
analysis, regressions of the dependent variables on the factors were 
determined. The resulting principal components equations contain all 
the original predictor variables. The use of equations which contain 
all of the important parameters should cause the design engineer, T.O. 
writer, and training or personnel planner to take a more comprehensive 
view of the problem. 
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The aim of this analysis was to intercorrelate those variables which are 
significantly related to performance, and to determine the minimum number 
of orthogonal factors required to express the original performance 
variables. The correlations of each of the three performance variables 
{performance time, T.O. time, and number of errors) with the remaining 
variables were tabulated in descending order, with a cutoff point at a 
correlation of 0.301 • Twenty variables correlated at 0,301 or higher 
with one or more of the performance variables {Table XII). These 20 
variables were entered into the orthogonal components analysis. 

From an orthogonal components analysis with 20 original variables, 20 
orthogonal components are extracted. The question is, how many of these 
components must be retained to adequately account for the variance in the 
original 20 variables? One recommended procedure is to stop where the 
eigenvalues drop below 1.00 {Harman, 1960, p. 363). In this analysis, 
this occurs when six orthogonal components have been identified. As an 
alternative, the eigenvalue of 0.50 which is reached with nine factors 
was considered. Table XIII lists, for each of the 20 original variables, 
the proportion of variance accounted for by the first 9 factors. The 
additional information contributed by retaining nine factors as opposed 
to six does not seem sufficiently impressive to justify the additional 
complexity. Therefore, most of the subsequent aialyses were run con- 
sidering only the first six factors. 

Table XIX presents the complete weights matrix from the orthogonal com- 
ponents analysis. Table XX presents the percents matrix, and Table 
XXI, the inverse matrix. Table XIV, derived from the percents matrix 
for the first 6 factors, indicates which of the 20 variables are accounted 
for by each of the 6 factors. A cell with no entry indicates that factor 
accounts for less than 10 percent of the variance of that variable; an 
open circle indicates more than 10 but less than 20 percent of that 
variable's variance is accounted for by that factor; and a filled circle 
indicates those variables which are more than 20 percent accounted for by 
a factor. The signs of five variables are reversed in order that all 
correlations with factor 1 {U]) are positive. 

A tentative grouping of variables is indicated along the right margin of 
Table XIV. Group I consists of those weighted positively by U] and 
strongly negatively by U2. Grcup II consists of those weignted by U] 
and weighted either weakly or not at all by U2. Group IV variables 
weight positively on U2 but not on U] ; and Groups V and VI each consist 
of single variables. 

Table XV lists the intercorrelations of these 20 variables. The corre- 
lations within any group are, with two minor exceptions in Group II, all 
positive. Group I correlations with Group II tend to be positive; I 
with III, positive or insignificant; I with IV, negative; and I with V, 
insignificant. For Group II, generally positive correlations with Group 
III are observed; II with IV, generally positive; II with V, mixed; II 
with VI, generally positive. Group III correlations with Group IV, V, 
and VI tend to be positive. Group IV tends to correlate negatively with 
V af.i VI. Group V has a very small correlation with Group VI. 
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TABLE XIII 

PROPORTION OF VARIANCE OF EACH VARIABLE (ROWS) 
ACCOUNTED FOR BY EACH OF THE FIRST NINE FACTORS (COLUMNS) 



nv t Kin 

VARIABL^^ 


Ul 


U2 


U3 


U4 


U5 


U6 


U7 


U8 


U9 


VARIANCE 


Zi 


0.1755 


0.2124 


0.1755 


0.2710 


0.0560 


0.0018 


0.0550 


0.0059 


0.0317 


0.9852 




0.2567 


0.0922 


0.3974 


0.0534 


0.1082 


0.0000 


0.0053 


0.0285 


0.0231 


0.9651 




0.0176 


0.6240 


0.0270 


0.2583 


0.0000 


0.0043 


0.0030 


0.0030 


0.0147 


0.9521 


AV 


0.5285 


0.3212 


0.906/ 


0.0016 


0.0001 


0.0198 


0.0805 


0.0034 


0.0004 


0.9625 


hi 

A A 


0.5392 


0.0168 


0.0880 


0.1027 


0.0101 


0.0055 


0.0035 


0.0233 


0.1197 


0.9092 


hi 


0.7747 


0.0027 


0.04?^ 


0.0044 


0.0777 


0.0196 


0.034: 


0.0003 


0.0030 


0.9599 


hi 


0.3038 


0.1366 


U.2654 


0.0013 


0.1061 


0.0893 


0.0050 


0.0052 


0.0234 


0 9366 


hi 


0.2928 


0.1232 


0.2154 


0.2265 


0.0001 


0.0223 


0.0190 


0.0018 


0.0307 


0.9322 


hs 


0.3224 


0.1648 


0.2029 


0.0052 


0.0001 


0.0018 


0.0235 


0.2048 


0.0018 


0.9277 




U.UjOj 


U.O4U/ 


n mil 


n n77i 


u.uoo/ 


n flDfln 
u.uuou 


u.uooo 


U.UUii 


U.UjDU 




Z22 


0.0179 


0.3728 


0.2756 


0.0667 


0.0124 


0.1545 


0.0277 


0.0076 


0.0268 


0.9624 


Z24 


0.3998 


0.0440 


0.0009 


0.0957 


0.2471 


0.0297 


0.0799 


0.0390 


0.0220 


0.9495 


Z29 


0.0117 


0.4115 


0.1694 


0.0595 


0.0611 


0.0339 


0.1263 


0.0013 


0.0662 


0.9412 


Z30 


0.5546 


0.0512 


0.0046 


0.2328 


0.0169 


0.0443 


0.0175 


0.0414 


0.0030 


0.9666 


hz 


0.0394 


0.5691 


0.0603 


0.0213 


0.0902 


0.0414 


0.0274 


0.0660 


0.0022 


0.9177 


hi 


0.3913 


0.0379 


0.2683 


0.0646 


0.1429 


0.0403 


0.0156 


0.0036 


0.0082 


0.9730 


Z34 


0.0293 


OMl 


0.1585 


0.6416 


0.0000 


0.0028 


0.0379 


0.0074 


0.0005 


0.9245 


hi 


0.4021 


0.1098 


0.0480 


0.0:03 


0.2029 


0.0003 


0.1018 


0.0000 


0.0440 


0.9195 


Z36 


0.1305 


0.4794 


0.0827 


0.0020 


0.0284 


0.0654 


0.0289 


0.0994 


0.0261 


0.9431 


Z41 


0.0794 


0.0596 


0.0041 


0.0346 


0.-^482 


0.4463 


0.0739 


0.0060 


0.0003 


0.9529 


VARIANCE 


5.3247 


4.4969 


2.5954 


2.1816 


1.44o9 


1.0320 


0.8061 


0.5410 


0.5047 


18.9287 


PERCENT 


26.62 


22.48 


12.97 


10.91 


7.23 


5.16 


4.03 


2.70 


2.52 


94.62 
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TABLE XIV 

RELATIVE AMOUNTS OF VARIANCE ACCOUNTED FOR BY EACH OF SIX FACTORS 
(Ui - Ue) ACROSS TWENTY VARIABLES. 



LEGEND: FILLED CIRCLE INDICATES <20% OF THE VARIANCE 
OPEN CIRCLE INDICATES> 10% BUT<20% 
NO ENTRY INDICATES <10% 





FACTORS 




*VARIASLE 
NO. 


Ul 


U2 


U3 


U4 


U5 


U6 


IH 


0 




0 








36(-) 


0 












10 


• 


•- 










15(-) 


• 


0- 






n 
u 




13 


* 












30 








• 






1 1 

11 








0 






24 










• 




33 






• 




0- 




2 






• 




0 




35H 




0 






• - 




19H 




0 










18 




0 




• - 






8 








• 






32 














20 






0 








29 






0 








22 






• 






0- 


34 






0- 








41 















♦SIGNS REVERSED ON FIVE VARIABLES TO MAKE ALL CORRELATIONS WITH Uj POSITIVE. 
**ROMAN NUMERALS REFER TO VARIABLE GROUPINGS DISCUSSED IN SECTION IV 
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The variables represented in the six groups are 



GROUP I AQE Electronics Scores (-) 

Convenience of System Controls (-) 
Taught at Lowry AFB 

GROUP II T.O. Specifies Tolerances for Measurements (-) 

Number of Steps in Checkout Procedure 
Number of Special Conditions required for Checkout 
Completeness of T.O. Checkout and Troubleshooting 

Information 
Number of Test Points 

Percentage of Checkout Procedure using BIT 
Months of Past Experience 

GROUP III Percentage of Measurements which are Quantitative 

(versus Go-No Go) (-) 
Percentage of Test Indications for which T.O. gives 

Quantitative Information (-) 
Number of Other Systems or Components required 

During Checkout 

GROUP IV Components can stand Repeated Adjustment 

Proportion of Plug-in Circuits (versus Hard Wired) 

Reliability of AGE 

Controls are Clearly Identified 

Taught at Chanute AFB 

GROUP V Percentage of Checkout Steps which are Automatic 

GROUP VI Convenience of Location of Test Points 

6. REGRESSIONS OF PERFORMANCE ON FACTORS 

Stepwise regressions were run to determine the relationships of the first 
six factors to performance. The F for inclusion was 3.84, and the £ 
for deletion was 3.00. Because tFe factors are orthogonal to each other, 
tolerance levc-l is not meaningful and was set at 0.00 for these runs. The 
resulting regression equations, multiple correlation coefficients, and 
standard errors of estimate are: 

performance time = 1714.1 + 1018.9 U^ - 393.8 U2 + 204.1 U3 - 550.2 U^ 



R = 0.924, S.E. = 563.6 seconds 



T.O. time = 585.9 + 443.3 U^ + 83.4 U3 
R = 0.933, S.E. = 221.9 seconds 



243.3 U^ + 109.6 Ug 



number of errors = 6.57 + 4.03 U^ - 0.79 U2 + 1.00 U^ - 1.20 U^ 



+ 0.92 Ug - 1.49 Ug, R 



0.926, S.E. = 2.21 errors. 
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The smallest of the £ ratios derived from analyses of variance testing 
the significance of the regressions was 22.97, significant at less than 
the 0.01 level. 
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SECTION IV 
DISCUSSION 



1. INTRODUCTION 



The primary objective of this study was to determine if and how perfor- 
mance might be predicted from the design characteristics of avionics 
equipment and from personnel factors such as training and aptitude. The 
two statistical analyses undertaken to answer this question (regression 
on the design variables themselves, and on factors made up of the design 
variables) both result in high multiple correlation coefficients ranging 
from 0.879 for training equipment cost on design variables to 0.974 for 
errors on design variables. 

Statistically, all of the multiple regressions reported are highly 
significant. In other words, the dependent variables in this study can 
be predicted surprisingly well from certain combinations and weightings 
of the independent variables. The high multiple regression coefficients 
are especially encouraging because none of the data was transformed to 
maximize correlations. A linear correlation model was used throughout 
this study. 

Ezekiel and Fox (195^, 'p. 301) point out that "the smaller the number of 
observations, the larger the number of independent variables considered, 
and the more complex the curves employed, the greater will be the 
tendency for the observed standard error of estimate tc understate the 
true error of estimate in the universe, and for the observed correlation, 
simple or multiple, to overstate the true correlation in the universe." 
Complex curves were not fitted in this study, but the number of observa- 
tions and the number of independent variables are such that some caution 
must be exercised in interpreting the results, and replication of the 
findings is most desirable. 



2. REGRESSIONS ON THE DESIGN VARIABLES 



The regression equations relating performance tiiiie and errors to the 
design variables are: 

performance time = 641.97 - 1327.06 Yg + 4.23 Y^^ ' 330.40 Ygg + 
354.38 Y32 

errors = 11.27 - 0.67 Y3 + 0.36 Y^g + 0-23 - 0.63 Y^g - 1.48 Ygg - 
0.83 Y30 

Both time and errors are dependent upon Yis (number of steps in checkout) 
and Y29 (reliability of test equipment). The other variables entering 
the equation for performance time are Y« (taught at Lowry AFB) and Y32 
(components can stand repeated adjustmertx). In the equation for errors, 
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in addition to Y13 and Y29, variables Y3 (past experience), Yi2 (T.O. uses 
standard symbology), Yis (number of other units required during checkout), 
and Y30 (number of special conditions required during checkout) also enter. 

The equation? for predicting training time and training equipment cost 
from the design variables are: 

training time = -75.66 - 0.01 Y^ + 9.93 Y^g + 7.85 Y^g + 4.97 Y^g and 

training equipment cost = 16.39 + 0.18 Y. - 3.67 Yoc + 28.67 Y^-. 

0 25 34 

Training time is a function of performance time, convenience of test 
points, number of other units required during checkout, and the clarity 
with which change data are presented in the T.O. Training equipment cost 
is a function of T.O. time, the extent to which identical circuits are 
used, and the use of automatic checkout. 

3. REGRESSIONS ON THE FACTORS 

In the equations resulting from stepwise regressions of the performance 
variables on the factors, performance time was found to be a function of 
factors Ui, U2, U3, and U4; T.O. time, a function of U] , U3, U4, and U5; 
and errors a function of all six factors. As a starting point for inter- 
preting these factors, the ways in which they relate to the performance 
measures can be considered. Factor U] enters positively into the 
equations for performance time, T.O. time, and errors. Factor U3 also 
enters positively into all three equations, and U4 enters negatively into 
all three. Factor U2 enters only into performance time and errors, and 
enters negatively for both. Factor U5 enters positively into T.O. time 
and errors, and U6 enters negatively into the equation for errors. Tables 
XIV and XV along witf the list of variables by group given in the 
text, provide clues toward naming the factors. It should be emphasized 
that Table XIV, as well as the discussion which follows here, implies 
that some variables do .not enter into some factors. This is a relative 
matter, and variables with less than 10 percent of their variance accounted 
for by a given factor receive no entry in Table XIV and are spoken of 
below as not present or not significant. In actuality, each factor is a 
function of all of the 20 variables which were entered into the orthogonal 
components analysis, with coefficients as listed in the inverse matrix 
{Table XXI). Equations expressing each factor in terms of the design 
variables can be written using the Table XXI coefficients. 

The first factor (U]) extracted by the orthogonal components analysis 
accounts for variance in the Groups I, II, and III variables of Table 
XIV. It seems reasonable to hypothesize that the variables in firoup I 
are associated primarily because Lowry (fire control systems) is the 
driving influence. Group II includes Yi3, number of checkout steps, as 
well as several other variables which are either obviously or less plainly 
related to the steps in the checkout procedure. Group III variables seem 
to cluster here because they relate to quantitative v^.sus qualitative 
checkout information. Groups I, II, and III enter 1^:to U] because of 
some common quality. Of the 20 variables in this analysis, there is only 
1» which has variance accounted for by only 1 factor. The most 

I 
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appropriate name for this factor, , appears to be "Length of the Check- 
out Procedure. " ' 

The second factor, U2, is distinguished from Ui in that Group I variables 
weight negatively on U2, Group II variables do not weight on U2, and 
Group IV variables do weight on U2. Group IV is made up of Chanute and 
four other variables, and some commonality exists in terms of Chanute. 
In U2, then, Chanute weights positively, and Lowry weights negatively. It 
seems reasonable to suggest that factor U2 represents "Equipment Com- 
plexity." Because the factors in the orthogonal components analysis are 
each completely independent of all others, U2 is independent of Ui . In 
extracting Ui, the variance associated with "Length of the Checkout 
Procedure" was removed from the correlation matrix. Factor U2, then, 
would more properly >e named "Equipment Complexity, adjusted for length 
of checkout procedure." 

Factor U3 is more difficult to name. Taking information from Table XIV, 
and changing signs of variables back to their original state because the 
usefulness of the changed signs is exhausted after the first two factors 
are identified, these results are obtained: 

U3 weights positively on, and accounts for more than 20 percent of the 
variance in: 

Y^g, T.O. specifies tolerances for measurements: 

Y^g, T.O. gives quantitative information; 

Y22» controls are clearly identified; 

Y^^j BIT is used; and 

Y2, past experience, 

U3 weights negatively on, and accounts for more than 20 percent of the 
variance in, 

Y-jg, number of other units required during checkout. 

According to the regression equation, as U3 increases, perfonnance time, 
T.O. time, and errors increase. Tentatively, U3 represents "Difficulty 
of Checkout Steps, adjusted for number of steps and for equipment 
function." This hypothesis receives some support from the correlations 
of the variables entering into U3 with variable Y42, weeKS of training, 
which fell just short of correlating highly enouqli with errors to be 
entered into the orthogonal components analysis. 

Factor U4 is related to performance time, T.O. time, and errors. Increases 
in U4 lead to improved times and errors, i.e., to shorter times and fewer 
errors. U4 is a function of AQE, number of special conditions required 
during checkout, T.O. provides complete information, Chanute, use of 
automatic checkout, and checkout depends on other units. It seems likely 
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that U4 can be named "Nonautomatic Checkout, adjusted for the effects 
of Ui, U2, and U3-" 

Factor U5 contributes positively to T,0, time and errors. This factor 
weights on number of test points, past experience, quantitative measure- 
ments from the test equipment, convenience of test point location, T.O. 
specifies tolerances, and use of BIT. This factor can perhaps be named 
"Diagnostic Information," .as adjusted for factors U] through U4- 

Factor U6 appears only in the equation for errors, and not in the equa- 
tions for performance and T.O, times. As U6 increases, number of errors 
tends to decrease, and U6 weights on convenience of test points and 
clearly identified controls. Factor Us appears to be a "Clarity of 
Information" factor. 

4. SCALING OF VARIABLES AND DIRECTIONALITY OF EFFECTS 

The regression equations given in the preceding sections express the 
dependent training and performance variables as functions of various 
independent variables, and of factors which are functions nf the indepen- 
dent variables. In some cases, the direction (positively or negatively) 
in which an independent variable enters into an equation is difficult 
to interpret adequately. An example of an easily interpretable design 
variable is Yig* number of other units required for checkout. As Yi8 
increases, the equations predict that task time, T.O. time, errors, and 
training time will increase. Less easily understandable are, for example, 
the predicted effects of Yw (as the T.O. is in more logical sequence, 
training time will increase) or Y32 (as components are better able to 
stand repeated adjustment, T.O. time will increase). An examination of 
the results indicates a possible relationship between the method of 
scaling a variable and the ease with which that variable's effects on 
the criterion measures can be interpreted. Of the 29 design characteris- 
tics used in this study, 14 were scaled objectively and 15 were scaled 
using expert judgments. Only two of the objectively scaled characteris- 
tics, Y33 and Y34, are difficult to interpret: as use of BIT increases, 
predicted task time, T.O. time, and errors increase; and as use of 
automatic checkout increases, T.O. time and errors increase. However, 
8 of the 15 characteristics which were scaled subjectively have seemingly 
paradoxical effects on predicted times or errors. These eight are Yiy 
and Y32, which were mentioned above, and variables Yll, Yi6, Y22, Y23i 
Y28. and Y38- 

Subjective scaling was used where no adequate method of objective scaling 
could be identified. Whether because of the nature of the subjectively 
scaled characteristics, or because of error or lack of reliability in the 
subjective scaling itself, these results emphasize the need for additional 
research directed toward developing methods for objectively quantifying 
additional design characteristics. 
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SECTION V 



CONCLUSIONS AND RECOMMENDATIONS 



1. PREDICTION EQUATIONS FOR PERFORMANCE 

One of the primary goals of this study was to investigate the relation- 
ship between job performance and equipment design characteristics. Two 
statistical methods v/ere used to relate the design characteristics data 
to the performance data: fi^st, stepwise multiple regressions of the 
performance variables on the design characteristics; and second, a factor 
anlaysis of the design characteristics followed by stepwise regressions of 
the performance variables on the factors. The smallest of the resulting 
multiple correlation coefficients was 0.879 for the regression of training 
equipment cost on the design characteristics, and the largest was 0.974 
for number of errors on the design characteristics. These large correla- 
tion coefficients signify that the equations are able to account for a 
very large part of the variance in the set of performance data collected 
for this study. 

Applications of these equations should, for the present, be made cautiously, 
and particular care should be taken to temper the Interpretation of results 
when any of the input data fall outside the ranges which entered into 
derivation of the equations. Validation and improvement of the equations 
is needed before they are implemented in the design of AF avionics 
equipment. 

2. PREDICTION EQUATIONS FOR TRAINING 

The second of the primary goals was to investigate the relationship 
between training and equipment design characteristics. The multiple 
regression equations for predicting training time and training equipment 
cost from design characteristics account for 83 percent of the observed 
variance in training cime, and 77 percent of the observed variance in 
training equipment coit. 

The equations for trailing time and for training equipment cost should be 
the subject of further controlled studies aimed at validating and Improving 
the present equations. The training times collected in this study were 
distributed across a wide range. However, the training equipment costs 
tended to cluster in the low range. Therefore, the equations for costs 
should be interpreted with care, and are particularly in need of validation 
across a better distribution of training equipment costs, 

3. INDEPENDENT VARIABLES: DESIGN CHARACTERISTICS 

In the absence of an adequate taxonomy of avionics design characteristics 
which affect training, this study began by establishing an extensive 
listing of characteristics which previous studies and expert opinion 
suggested were potentially important. The initial listing of 49 design 
characteristics was reduced to 29 by interviewing instructors and students 
to determine which of the 49 were believed to be most important in the 
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actual training situation. Of the 29, only 19 appear in one or more of 
the equations for predicting performance and training. The remaining 10 
which did not enter into any of the equations either do not relate to 
performance and training for the functional checkout tasks, or overlap 
with the included 19 to such an extent that the 10 contribute no signifi- 
cant additional information. The design characteristics considered in 
future studies in this area should be tailored to include the 19 signifi- 
cant design variables, and to omit many or all of the 10 nonsignificant 
variables. 

Further research is needed to establish a taxonomy of design characteris- 
tics which adequately spans present and future equipment, as well as the 
complete range of maintenance tasks. The listing established here is 
based on data collected in the training situation, not on the flight line 
or in the shop. To the extent that line and shop maintenance requires 
activities not included in the present study, t!ie list of design charac- 
tjristics should be expanded. For example, remove and replace activities 
are specifically excluded in almost all of the training courses; trouble- 
shooting may be to a level not reached by the functional checkout; and 
adjustment activities are very frequently not practiced in the functional 
checkout. 

4. INDEPENDENT VARIABLES: PERSONNEL CHARACTERISTICS 

Four personnel variables were included in the present study: AQE elec- 
tronics score; past experience; past training; and performance observation 
week. All four entered into one or more of the prediction equations, and 
were sufficient for accurately fitting the observed performance data. For 
the three-level formal school training situation, with the present makeup 
of student personnel, these personnel variables appear to be quite 
adequate. For more advanced five- or seven-level courses, for OJT, and 
for field or shop performance, it is probable that additional person.iel 
variables would be needed to achieve accurate prediction. 

5. INDEPENDENT VARIABLES: ENVIRONMENTAL VARIABLES 

The three so-called environmental variables included in this study reflect 
the three training school locations, Chanute, Keesler, or Lowry AFB. The 
Chanute, Keesler, and Lowry variables may indicate equipment complexity 
and training differences between training centers rather than physical 
location. Fire control systems are taught at Lowry, communications systems 
at Keesler, and navigation and flight control at Chanute. Future research 
should investigate these possibilities and extend considerations of equip- 
ment complexity and its influence on performance beyond the formal training 
situation to the organizational and intermediate maintenance environments. 

6. DEPENDENT VARIABLES: PERFORMANCE 



Two time measures, performance time and T.O. time, were included in this 
study. The correlation of performance time with T.O. time is 0.848, 
indicating that T.O. time and performance time have 71 percent of variance 
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in common. It would appear to be an unnecessary refinement, in further 
research in this area, to continue to collect both measures. 

7. DESIGN FACTORS 

Six factors were isolated by an orthogonal components analysis and assigned 
names. Each factor is made up of portions of the variances of the 20 design 
characteristics which correlated significantly with the performance measures. 
The factors, in order of identification, are: 

Length of Checkout Procedure 
Equipment Complexity 
Difficulty of Checkout Steps 
Nonautomatic Checkout 
Diagnostic Information 
Clarity of Information 

Each factor in the list is derived from residual variance with the effects 
of the preceding factors removed. Also, each factor can be expressed in 
terms of the original 20 design variables by normalizing each variable 
to a mean of 0 and a standard deviation of 1, and then assigning coefficients 
as indicated in the inverse matrix (Table XXI). 

Assigning names to factors is partlv science, but the remainder is art, 
wishful thinking, or desperation. The r.^tionale for naming these factors 
has been described in considerable detail, and the necessary weights 
and percents matrices are included so that the process can be reconstructed 
in full. The accuracy and the usefulness of the names should be validated 
during practical applications of the equations and in research to replicate 
and extend the present study. 

8. RECOMMENDATIONS FOR APPLICATION OF RESULTS TO AIR FORCE SYSTEM DESIGN 

The results of this study provide a quantitative means for predicting 
training time, training equipmenc cost, and performance time and errors, 
given certain information about equipment design. The statistical 
evaluations of the significance of the results certainly indicate sufficient 
confidence levels that these results offer promise for the future. However, 
further research and validation are needed before practical applications 
are warranted. A highly desirable method of validation is to utilize the 
prediction equations during the design of AF avionics systems. The best 
available quantitative information on the design should be fed into the 
prediction equations to derive predicted training times, costs, and 
performance figures. These predictions should be compared with predic- 
tions derived from the methods currently in use, and followed through into 
operational use of the system to obtain measures of validity. Training and 
performance are two human resources items that contribute heavily to the 
life-cycle costs of AF systems. The results of this study strongly suggest 
a means can bo H'^veloped for introducing these items into the system design 
process quantitatively. When developed and implemented, this could lead 
to increased operational capability at decreased cost. 
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TABLES OF DATA AND RESULTS 
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ASN-91 
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9.90 
9.80 
7.16 
6.00 
6.83 
8.16 
8.83 
6.40 
5.04 
6.20 
5.62 
5.60 
7.25 
7.40 
8.76 
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AGE 
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RELIABLE 
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10.00 
8.98 
9.00 
9.02 
6.25 
7.16 
7.00 
5.16 
9.08 
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8.50 
8.50 
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7.41 
7.33 
8.33 
8.20 
9.88 
9.68 
9.82 
9.56 
9.20 
9.56 
7.22 
7.20 
7.20 
7.08 
5.50 
8.50 
8.66 
9.41 
9.58 
9.75 
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5.00 
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9.80 
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NO. OF 
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FUNCTIONAL LOOPS 


ASN-48 NAVIGATION 
ASN-48 PLATFORM 
ARC-51 TRANSMITTER 
ARC-51 MAIN RECEIVER 
ARC-51 TUNNING 
ARC-34 TRANSMITTER 
ARC-34 MAIN RECEIVER 
ARC-34 TUNING 
nOl AFCS PITCH 
HOI AFCS ROLL 
nOl AFCS YAW 
nil AFCS PITCH 
Hll AFCS ROLL 
nil AFCS YAW 
Hll CADC MACH 
nil CADC ALTITUDE 
nil CADCTAS 
APQ-109 TRANSMITTER 
APQ-199 EFC 
APQ-109 ASE 
APQ-109 AIM POINT 
APQ-120 TRANSMIHER 
APQ-120 EFC 
APQ-120 CW 
APQ-120 ASE 
APQ-120 An DOT 
ASG-19 TR 
ASG-19 EFC 
ASG-19 ON-T 
ASN-91 
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FUNCTIONAL LOOPS 


ASN-48 NAVIGATION 
ASN-48 PLATFORM 
ARC-51 TRANSMITTER 
ARC-51 MAIN RECEIVER 
ARC-51 TUNING 
ARC-34 TRANSMITTER 
ARC-34 MAIN RECEIVER 
ARC-34 TUNING 
nOl AFCS PITCH 
nOl AFCS ROLL 
nOl AFCS YAW 
nil AFCS PITCH 
nil AFCS ROLL 
nil AFCS YAW 
nil CADCMACH 
nil CADC ALTITUDE 
nil CADC TAS 
APQ-109 TRANSMITTER 
APQ-109 EFC 
APQ-109 ASE 
APQ-109 AIM DOT 
APQ-120 TRANSMITTER 
APQ-120 EFC 
APQ-120 CW 
APQ-120 ASE 
APQ-120 AIM DOT 
ASG-19 TR 
ASG-19 EFC 
ASG-19 ON-T 
ASN-19 
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FUNCTIONAL LOOPS 


ASN-48 NAVIGATION 
ASN-48 PLATFORM 
ARC-SI TRANSMITTER 
ARC-51 MAIN RECEIVER 
ARC-51 TUNING 
ARC-34 TRANSMI I lER 
ARC-34 MAIN RECEIVER 
ARC-34 TUNING 
nOl AFCS PITCH 

CIAI A C/^C DAI 1 

nOl Arcs ROLL 
nOl AFCS YAW 
nil AFCS PITCH 
HU AFCS ROLL 
nil AFCS YAW 
nil CADC MACH 
nil CADC ALTITUDE 
nil CADC TAS 
APQ-109 TRANSMITTER 
APQ-109 EFC 
APQ-109 ASE 
APQ-109 AIM DOT 
APQ-120 TRANSMITTER 
APQ-120 EFC 
APQ-120 CW 
APQ-120 ASE 
APQ-120 AIM DOT 
ASG-19 TR 
ASG-19 EFC 
ASG-19 ON-T 
ASN-91 
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TABLE XVII 

LIST OF PERFORMANCE EXAMINATIONS, LINE REPLACEABLE UNITS, AND 
TEST EQUIPMENT FOR THE FUNCTIONAL LOOPS 



SUBSYSTEM 
LOOPS 


PERFOnMNCE EXAMINATIONS 


LINE REPUCEABLE UNITS 


TEST EQUIPMENT 






APQ-120 




TRANSilTTER 


BIT 


RADAR TRANSMIHER 
POWER SUPPLY 
CONTROL MONITOR 
RADAR SET CONTROL 
ANTENNA 

ELECTRICAL SYNCHRONIZER 
CONTROL OSCILUTOR 
WAVEGUIDE ASSEMBLY 


RADAR TEST SH AN/APM-ZISA 
OSCILLOSCOPE AN.1fiM-l«K: 


ELEriRICAL 
FREQUENCY 
CONTROL 


BIT 


RADAR TRANSMIHER 
CONTROL MONITOR 

CONTROL OSCILUTOR 

RADIO FREQUENCY OSCtLUlTOR 

WAVEGUIDE ASSEMBLY 


NONE 


ASE 


BIT 

ASE (RTS) 
ASE (CTS) 


TARGH INTERCEPT COMPUTER 
INTRA TARGET DATA 
INDICATOR (FVD) 
MTRA TARGET DATA 
INDICATOR (AFT) 
CONTROL INDICATOR 


RADAR TEST SET AN/APM-2I3A 
COMPUTER TEST SET AN/APM-212 
ELECTRONIC VOLTMETER AN/ASM-340 
AN/ASM-340 


AN DOT 


BIT 

AIM DOT 


TARGH INTERCEPT COMPUTER 
ANTENNA 

ANTENNA CONTROL 
CONTROL INDICATOR 
RADAR SET CONTROL 
INTRA TARGET DATA 
INDICATOR (FWD) 
MTRA TARGET DATA 
»DICATOR(AFD 


RADAR TEST SET AN/APM-213A 
ELECTRONIC VOLTMETER 

AN/ASM-340 
OSCILLOSCOPE AN/USM-1MC 


CW ILLUHWATOR 


CiMODUUTKMANO NOISE 
PSEUOO SIGNAL GENERATION 
PSEUOO SIGNAL DISTRIBUTION 
BIT 


TARGH INTERCEPT COMPUTER 
RADIO FREQUENCY AMPLIFIER 
MDOUUTOR-OSaLUTOR 
RADAR TRANSMinER 
CONTROL MONITOR 
RADAR SET CONTROL 
CONTROL OSCILUTOR 
WAVEGUIDE ASSEMBLY 


RADAR MOOUUTKM TEST SET 

AN/AP»nHB 
RF POWER TEST SH TS-20SS/ 

AWM-ll 






APQ>>t« 


TRANSMTTER 


BIT 

MAGNETRON CURRENT 


CONTROL POWER SUPPLY 
RADAR SET CONTROL 
AUXIUARY RADAR SET CONTROL 
RADAR RECEIVER TRANSMIHER 
MOOUUTOR 
VOLTAGE MONITOR 
ELECTRICAL SYNCHRONIZER 
ANTENNA 


NONE 


ELECTRICAL 
FREQUENCY 
CONTROL 


BIT 


RADAR SET CONTROL 

RADAR RECEIVER TRANSMinER 

VOLTAGE MONITOR 

ELECTRICAL FREQUENCY CONTROL 


NONE 


ASE 


BIT 


INDICATOR CONTROL UNIT 
AZ-EL-RANGE INDICATOR (I^WD) 
AZ-EL-RAN6E INDICATOR (AFT) 
RADAR Sn CONTROL 
TARGET INTERCEPT COMPUTER 
ELECTRICAL SYNCHRONIZER 


NONE 


AIM DOT 


BIT 


AZ-EL-RANGE INDICATOR (FVD) 
ANTENNA 

ELECTRICAL SYNCHRONIZER 
RADAR SET CONTROL 
CONTROL POWER SUPPLY 
RADAR MOOUUTOR (CW) 
TAROn INTERCEPT COMPUTER 
INDICATOR CONTROL 
AZ-EL-RANGE INDtCATOR (AFT) 


NONE 
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TABLE XVI! 

LIST OF PERFORMANCE EXAMINATIONS, LINE REPUCEABLE UNITS, AND 
TEST EQUIPMENT FOR THE FUNCTIONAL LOOPS (Continued) 



1 SUBSYSTEM 1 


PERFOmANCE EXARWATIONS | 


UNE "REPLACEABLE UNITS J 


TEST EQUIPMENT 


1 Fill CAOC 




1 imJE AIRSPEED 


FUHCTIOHAL CHECK 


rOTAL TEMPERATURE PROBE 
TRUE AIRSPEED INDICATOR 
AIR DATA COMPUTER 


PNEUMATIC TEST SET nU-2« 


1 ^ 

1 lACH 


FUNaiONAL CHECK 


MAXMIM SAFE HACH ASSEMBLY 
AIRSPEED MACH INDICATOR 
AMI AMPLIFIER 
AIR DATA COMPUTER 


PNEUMATIC TEST SET nU-2» 


1 ALTITUDE 


FUnaiONAL CHECK 


AIR DATA COMPUTER 
ALTITUDE VERTICAL VELOCITY 

INDICATOR 
AWl AMPLIFIER 


PNEUMATIC TEST SET HU-MS 

_ 




Fill AFCS 




1 PITCH 


FUNaiONAL CHECK 


PITCH FLIGHT CONTROL COMPUTER 
YAf FUGHT CONTROL COMPUTER 
FEEL AND TRMI ASSEMBLY 
AUTOPILOT DAMPER PANEL 
CONTROt STICKS 

AUXILIARY FLIGHT CONTROL PANEL 
GROUND CHECK PANEL 


NONE 1 


1 ROLL 


FUNCTIOfUL CHECK 


ROLL FLIGHT CONTROL COMPUTER 
YAV FLIGHT CONTROL COMPUTER 
FEEL AND TRW ASSEMBLY 
AUTOPILOT DAMPER PANEL 
CONTROL STICKS 
GROUND CHECK PANEL 


NONE 


1 YAi STABILITY 
1 AUGMEflTATICII 


FUNCTIOfUL CHECK 


VAN FLIGHT CONTROL COMPUTER 
FEEL AND TRHIASSEHBtr 
LATERAL ACCELEROMETER ASSEMBLY 
YAi RATE GYRO ASSEMBLY 
ROLL RATE GYRO ASSEMBLY 
ANGU OF SIDESLIP TRANSMITTER 
ANGU OF AHACK TRARSMinER 
AUTOPILOT DAMPER PANEL 
CENTER AUXILIARY FLIGHT CONTROL 
PANEL 

AUXILIARY FLIGHT CONTROL TEST 
PANEL 


NONE 

1 






m AFCS 




1 PITCH ATTITUDE 
1 HOLD 


FUNCTIONAL CHECK 


AFCSCAUBRATOR 
VERTICAL GYRO 

CONTROL STICK FORCE TRANSDUCER 
FUNCTIONAL SELECTOR PANEL 
■ACH AND QC TRANSDUCER 
STABILATOR SERVOS 
STABILATOR POSITWN TRANSMTfTER 


TEST SET UG(37A7 

POSITMN POTENTKMETER TESTER 

UG3(BA-2 
AN/P$M-« METER 


1 ROLLATTITUOE 
1 MOLD 


FUNCTIONAL CHECK 


AFCS CALIBRATOR 

VERTICAL GYRO 

CONTROL STICK 

FUNCTK)N SELECTOR PANEL 

MACH AND QC TRANSDUCER 

AILERON INTEGRATED POiER CYUNDER 

AILERON POSITION TRANSMinER 


TE$T$CTUG07A7 

POSITKMI POTENTMMETER TESTER 

U63(0A<2 
AN/PSM-6 METER 


1 YAf STABILITY 
1 AUSHENTATKW 


FUNCTKNIAL CHECK 


AFCS CAUBRATOR 

YAW RATE GYRO 

ROLL RATE GYfO 

LATERAL ACCELEROMETER 

MCH AND QC TRANSDUCER 

RUDDER INTEGRATED POiER CYLINDER 


TEST SET UGSJ7A7 
AN/PSM-( METER 
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TABLE XVII 

LIST OF PERFORMANCE EXAMINATIONS, LINE REPLACEABLE UNITS, AND 
TEST EQUIPMENT FOR THE FUNCTIONAL LOOPS (Continued) 



SUBSYSTEM 
LOOP; 


PERFORMANCE EXAMINATIONS 


LINE REPLACEABLE UNITS 


TEST EQUIPMENT 




ASG^M 


TRANSMinER 


MINIMUM PERFORMANCE CHECK 
TRANSMinER SYSTEM CHECK 


RADAR ANTENNA 
RADAR TRANSMinER 
RADAR CALIBRATION CONTROL 
WAVEGUIDE COUPUNG 
AUTOMATIC ELECTRICAL FREQUENCY 
CONTROL 


RADAR ANALYZER 

nspii 1 A^^mic AM /lieu ft Aiu^ 
OSCILLOSCOPE AN/USM-140C 

RADAR TEST SH UPM-106 


AUTOMATIC 

tLtCTRICAL 
FREQUENCY 
CONTROL 


AEFC FUNCTIONAL CHECK 


RADAR ANTENNA 

AUTOMATIC ELECTRICAL FREQUENCY 

CONTROL 
POST l>F AMPLIFIER 
RADAR TRANSWnER 
WAVEGUIDE COUPLING 


RADAR ANALYZER 
OSCILLOSCOPE AN/USM-140C 


ONTARGET 
STEERING 


MINIMUM PERFORMANCE CHECK 
STEERING DOT ZERO 
STEERING DOT SCALE FACTOR 


DIRECT RADAR FLIGHT INDICATOR 
RADAR ANTENNA 
ELECTRICAL SYNCHRONIZER 


RADAR ANALYZER 
OSCILLOSCOPE AN/USM-140C 




A$N>« 





FNTIRF SVSTFll 


TACTICAL COMPUTER 

MEMORY LOADING AND VERIFICATION 

TEST SELF-TEST 

INSTALUTKM AND COMPUTER LOADING OF 
OPERATIONAL TEST PROGRAM TAPE 

OPERATIONAL TEST PROGRAM TFSTS 

INSTALUTKM AND COMPUTER LOA?>NG OF 
OPERATIONAL FLIGHT PROGRAM 

OPERATIONAL CNECK 


TACTICAL COMPUTER 

TACTICAL COMPUTER CONTROL PANEL 

1 


CbMPUTER MEMORY LOADER 
VERIFIER AN/A$M-3)$ 






A$N-4I 






SYSTEM TEST PREPARATION PROCEDURE 
PROGRAMMED TEST PROCEDURE 
SCHULER (VELOCITY) TEST PROCEDURE 


"^ER 

b.'T^. SIGNAL DISTRIBUTION UNIT 
NAV. JION SET CONTROL 
INERTIAL PUTFORM 


INS TEH SETAN/ASM-m 


PUTFORM 
ALIGNMENT 


SYSTEM TEST PREPARATION PROCEDURE 
REPEATABILITY TEST PROCEDURE 
AniTUDE ALIGNMENT TEST PROCEDURE 


COMPUTER 

OUTPUT SIGNAL DISTRIBUTION UNIT 
NAVIGATION SET CONTROL 
INERTIAL PUTFORM 


MS TEST SET AN/ASK-IM 






ARC-34 


TRANSMinER 


FUNCTIONAL CHECK 


RECt /ER-TRANSMinER 
CONTROL PANEL 
ANTENNA 

UHF ANTENNA REUY 


WATTMETER AN/URM-11 


MAIN RECEIVER 


FUNCTIONAL CHECK 


RECEiVER-TRANSMinER 
CONTROL PANEL 
ANTENNA 

UHF ANTENNA REUY 


SIGNAL GENERATOR AN/U$M-44 
OUTPUT METER TS-SIS 


TUNING 


FUNCTKNIAL CHECK 


RECEtVER-TRANSMinER 
CONTROL PANEL 


SIGNAL GENERATOR AN/USM-M 






ARC-SI 


TRANSMinER 


FUNCTIONAL CHECK 


RECEIVER-TRANSMinER 
CONTROL PANEL 
ANTENNA 


NONE 


MAIN RECEIVER 

1 


FUNCTIONAL CHECK 


RECEIVER-TRANSMinER 
CONTROL PANEL 
ANTENNA 


SIGNAL GENERATOR AN/USM-44 
OUTPUT METER TV 'SS 


1 TUNING 


FUNCTIONAL CHECK 


RECEIVER-TRANSMinER 
CONTROL PANEL 


SIGNAL GENERATOR AN/U$M-44 
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TABLE XVIII 
CORREUTION MATRIX (Continued) 



VARIABLE 
NUMBER 


27 


28 


29 


30 


31 




99 

33 


91 

34 


9C 

35 


9£ 

3o 


77 

3/ 


98 

3o 


90 

39 


lA 

40 


11 

41 


19 


f4 


1 


A lAA 


A 7U 


0.46O -0.199 


-0.375 


A Aca 


-O.Jbfl 


_n 1 71 
-0.1/1 


n 9fK 
U.2U0 


A 9AJ 

0.304 


A CI a 
-0.bl9 


n 111 


n vein 

— U.IUU 


n lilli 

U.919 


-fl Ifti 


-0.444 


-A All 
— w.uo/ 


L 


tt.lUb 


-0.219 


0.045 


0.366 


Oill 


-U.U/4 


A 9C9 

0.353 


_n ACQ 
-0.059 


n n7i 
U.U/1 


_n 171 
-0.1/1 


n 9gc 


n 1 19 


n ni7 


n 991 
-U.£01 




0 in? 


v.tn/ 


\ 
3 




U.4I2 


-0.380 


Oil5 


-0.658 




— v.4W» 


-fl 1i9 


A 99n 


-U.413 


n 19A 
-U.43U 


_n CAi 


n ICO 


U.b3b 


U.V/D 


n jic 
— U.^/J 


-0 D47 




0.141 


-0.189 


-0.349 


0.414 


0.199 


A AA9 


A 99C 


n 919 

U.312 


-0.295 


-0.399 




_n 51 1 
-0.211 


n A7e 
-0.0/ b 


A ica 
-0.1b9 


0.2 OU 


— U.UtJ 


n 9QC 
U.29b 


C 

3 


A noL 
0.095 


n 19A 
-OJ20 


0.025 


0.349 


0i85 


D.3U9 


A 91C 

0.3 /b 


0.4oo 


-0.322 


— vjC25 


n 191 

U.134 


n IMC 
0 095 


A 1 la 
0.149 


-0.1 b3 


U.1J9 


_n 501 
-0.291 


n £11 

U.bl4 


b 


A ICl 

0.2b/ 


n ton 


-OilO 


0.416 


0.181 


A MB 


0.401 


n iM 

o.m 


A 919 

-0.313 


A 99C 

-0.32b 


A A19 

-O.013 


n 191 
— U.124 


n Ml 


_n lie 
-0 lib 


n 917 

0.31/ 


-U.U54 


n 1X1 


7 


A A19 

0.012 


A ?M 


0.559 -0.043 


-Oil4 


A 9C9 

0.253 


A nA9 

-O.0D3 


A Aia 
-0.019 


-0.232 


U.5tf9 


A 1A1 

-0.40/ 


U.3o4 


n 97C 


A 1 ca 
0.159 


_n 17C 
-0.130 


n |«A 


0 111 


0 
0 


A Aid 


D229 


0.528 -0.069 -O.084 


n AC7 
U.4b/ 


n ii9 
U.142 


n 1 79 
-U.l /3 


_n 117 
-0.11/ 


A jan 
0.490 


A CAQ 

-0.503 


n 919 

U.343 


A 9a9 
0.393 


n 99C 


n 1*9 


n 9A9 


n no 


Q 


-0.349 


n 1 ti 

-0.1 M 


-Oi04 


-0.703 


0.247 


A 9flC 

-0.303 


A cia 
-0.5/9 


A AM 

0.098 


A 9(U 

0.298 


n KM 
U 199 


A 9A1 

0.201 


n n7i 
u.u/o 


A AA9 
0.003 


_n A7A 
-0.0/0 


-fl 109 


n 1(19 
U./x 


n AOi 
-U.U9/ 


in 


..294 


A AJO 

-0.048 


-0.306 


0.692 


-0.143 


-A icn 


U.309 


V.Vic 


-U.150 


n Ml 
-U.DJl 


n 9Q1 


-0.3oO 


— U.jPb 


n lie 


n lii 


J1 i9fi 


0 91K 


1 1 
II 


U.4UJ 


U.440 


-0.081 


0.646 


-0.411 


U lb3 


n ii c 


n niii 

U.U91 




-U.£Ob 


n 9A« 

-U.jUO 




n in? 


U.IM 


n 911 


_n 1X9 


0 190 


Ic 


U.I90 


A CO 


-0.175 -0.193 


-0.245 


_n 1 7fl 
-0.1/0 


-0.292 


n 1 99 
u 133 


-0.22P 


-U.U9U 


n 91A 


-fl 119 


n 9n7 
0.30/ 


n 9fl£ 


n lAi 


n nm 


0 Iflfl 
U.IW 




U.2/4 


-<I.Ud4 


0.103 


0.600 


0.027 


A 9fla 
D.209 


U.5W 


n iu 
u.l 50 


n ^ci 
-0.351 


-0.195 


_n 1 J A 
-0.140 


n n7C 

U.U/5 




-U.U03 


n 91 1 


n 99C 
— U.330 


n 9£Q 


1 J 

14 


0.219 


A AJO 


-0.018 


0.007 


-0.153 


A 9CA 

-0.350 


A tea 
-0.4o9 


-u.Obb 


n £91 


-0.13/ 


-0 439 


-O.U/o 


_n 177 
-0.3// 


n 79£ 
U./3b 


-U.WfO 


_fl w 


-U.lUb 


1 c 


-0.441 


-0.41/ 


0.014 


-0.192 


0.110 


A 1C1 

-O.lbl 


A tlMC 


A 9Ai 

-0.304 


A MAM 

0.404 


A All 

0.0/1 


A CO 

O.bbo 


A 1 01 

0.1 o4 


-0.191 


n C99 
-0.532 


n A7r 
-O.U/b 


A iia 
0.419 


_n 1 Ji 
-0.341 


16 


0.059 


-0.089 


0.631 


0.108 


-0.144 


0.340 


0.254 


-0.001 


-0.195 


0.636 


-0i87 


0.618 


0.510 


-0.138 


0.152 


-0.115 


Oi25 


17 


-0.110 


0.453 


-0.023 


-0.085 


-0.384 


-0.196 


-0.498 


0.223 


0.092 


0.061 


-0.373 


-0.205 


0.034 


0.522 


-0.187 


-0.161 


0.211 


18 


0.034 


0^45 


-O.O30 


0.130 


0.177 


0.344 


0.067 


0.740 


-0.594 


-0 081 


-0.062 


-0.010 


0.174 


0 071 


-0.110 


-Oi56 


0.773 


19 


-0J65 


-0.349 


0.008 -0.376 


-0.062 


-0.187 


-0.229 


-0.254 


0.592 


-0.020 


0.384 


0123 


•1.255 


-0.196 


-0.038 


Oi96 


-0il8 


20 


-O.069 


-O.082 


0.506 -0.122 


0.504 


0.699 


0J82 


0.188 


-0.266 


0.482 


-0.108 


0.617 


0.684 


-C.C97 


-C.3< 


0.104 


0.198 


21 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 ' 


0.0 


22 


-0.178 


-0.357 


0.474 -0.247 


0.358 


0.499 


0.324 


0.111 


-0.261 


0.546 


-0.144 


0.633 


0.6?4 


-0.315 


0.016 


0.350 


0.143 


23 


-0.351 


-0.354 


0.572 


-0.210 


0.395 


0.697 


0.317 


0.099 


-0.037 


0.771 


0.087 


0.855 


0.640 


-0.322 


-0.192 


0.243 


0.130 


24 


0.697 


0.083 


-0.114 


0.510 


-0.177 


-0.257 


0.296 


-0.206 


-0.170 


-0.525 


-0.394 


-0.164 


-0.329 


0.208 


0.119 


-0.296 


-OiQ2 


25 


0.070 


-0.102 


-0.150 


0.213 


0.250 


0.164 


0.211 


0.161 


-0^51 


-0.040 


-0.088 


0.930 


-0.122 


0.007 


-0.117 


0.107 


-0.118 


26 


0.313 


0.373 


-0.093 


0.645 


-0.687 


-0.300 


0.090 


-0.194 


-0.087 


-0.310 


-0.091 


-0.507 


-0.368 


0.197 


0.368 


-0.550 


-0.018 


27 


1.000 


0^97 


-0.283 


0.369 -0.314 


-0.421 


-0.011 


-0.190 


-0.152 


-0.337 


-0.507 


-0.357 


-0.180 


0.452 


0.059 


-0.305 


-0.165 


28 




1.000 


0.072 


0.204 


-0.317 


-0.119 


-0.210 


0.066 


-0.196 


-0.232 


-0.348 


-0.267 


0.040 


0.405 


-0.140 


-Oi85 


0.057 


29 






1.000 -0.022 


0.028 


0.488 


0.240 


-0.149 


0.110 


0.511 


-0111 


0.778 


0.375 


-0.163 


-0.254 


-Oi43 


0.084 


30 








1.000 -0.435 


-0.025 


0.641 


-0.308 


-OJ63 


-0.359 


0.03b 


-0.261 


-0.308 


-0.112 


Oi87 


>0.456 


-0.194 


31 










1.000 


0.407 


0.061 


0.421 


0.002 


0.127 


0J48 


0.361 


0.351 


-0.2(2 


-Oi82 


0.345 


Oi79 


32 












1.000 


0.508 


0.252 


-0.373 


0.464 


0.191 


0.529 


0.539 


-0.367 


-O.056 


-0.061 


Oi93 


33 














1.000 


-0.254 


-0.513 


-O.OOO 


0.320 


0.212 


0.154 


-0.627 


0.245 


-0.096 


-0.139 


34 
















1.000 


-0^67 


0.003 


0.088 


-0.006 


0.273 


0.068 


-0.141 


0.013 


0.796 


35 


















1.000 


0.045 


0.009 


0.169 


-0^66 


0.302 


-0.190 


-0.018 


-0.296 


36 




















1.000 


-41.094 


0.650 


0.665 


-0.098 


-0.016 


0.295 


0.020 


37 






















1.000 


0.133 


-0.W8 


-0.761 


-0.013 


0.333 


0.119 


38 
























1.000 


0.455 


-0.366 


-0.315 


0.151 


0.140 


39 


























1.000 


-0.160 


-0.029 


0.251 


Oi73 


40 




























1.000 


-0.092 


-0357 


-0.065 


41 






























l.ObO 


-0.118 


-0.102 


42 
































1.000 


-0.235 


43 


































1.000 
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CM 


0.0251 
0.0064 
-0.0165 
-0.0093 
0.0107 
n nt97 


0.0112 
-0.0012 
-0.0067 

0.0066 
-0.0011 
-0.0098 
-0.0094 
-0.0118 
-0.0033 

0.0133 
-0.0006 

0.0024 
-0.0060 

0.0007 


<n 

5 


0.0271 
0.0189 
-0.0055 
0.0276 
0.01C8 
-0.0533 
0.0073 
0.0029 
-0.0207 
-0.0066 
0.0565 
-0.0057 
-0.0210 
0.0258 
0.0191 
-0.0146 
-0.0001 
0.0183 
-0.0140 
-0.0044 


oo 

5 


0.0257 
0.0257 
0.0475 
0.0091 
-0.0411 


-0.0092 
-0.0209 
0.0257 
0.0242 
0.0036 
-0.0397 
-0.0245 
0.0305 
-':.0264 
-0.0039 
0.0233 
-0.0298 
-0.0253 
0.0051 




-0.0156 
-0.0581 
-0.0163 
0.0050 
0.0141 


0.0449 
0.0118 
0.0005 
0.0584 
0.0201 
-0.0157 
0.0037 
0.0331 
-0.0049 
-0.r650 
-0.0289 
0.0064 
-0.0209 
0.0130 


u> 


-o.o:5o' 

-0.0447 
-0.0534 
-0.0567 
-0.0097 
-0.0429 
-0.0669 
0.0239 
0.0312 
0.0451 
0.0137 
-0.0177 
0.0101 
0.0719 
-0.0520 
0.0741 
0.0282 
0.0624 
-0.0129 
0.0123 




-0.0221 
0.0737 
0.0057 

-0.1616 
0.0198 
0.0108 


0.0270 
-0.0142 
-0.0082 
-0.0420 
-0.0205 
0.0205 
0.0090 
0.0722 
0.0767 
-0.0576 
0.0402 
0.0061 
-0.0570 
0.0341 




-0.0631 
0.0196 
0.1226 

-0.0331 
0.0198 
00470 


0.0126 

0.1406 

0.0023 
-0.0782 

0.0649 
-0.0766 
-0.0224 
-0.0536 
-0.0442 

0.0429 
-0.0825 

0.0870 
-0.0689 

0.0083 


CO 


0.0638 
0.1126 
-0.0238 
-0.0122 
-0.0554 


0.0062 
0.1991 
0.0841 
0.1140 
-0.1064 
0.0592 
-0.0277 
-0.0041 
0.0171 
-0.0377 
-0.1270 
-0.0538 
U.0353 
0.0823 


CM 

5 


0.0578 
-0.0626 
0.0369 
-0.0219 
-0.0229 
0.1024 
0.0826 
0.0690 
0.0999 
-0.0672 
0.0240 
0.1127 
-0.1955 
0.1140 
0.0356 
0.0298 
0.0481 
0.0627 
0.1837 
-0.0853 




c; 


0.0280 

0.1292 
0.0165 
0.1205 

-0.0943 
0.2172 
0.0304 

-0.0081 
0.0689 

-0.0039 
0.122? 
0.0822 

-0.0304 

-0.1900 
0.0289 
0.2092 
0.0280 
0.0240 
0.1055 


5 


-0.0179 
-0.0719 
0 0916 
0.0715 
-0.2637 
0.0206 
0.0384 
-0.0346 
-0.2300 
0.1301 
-0.1308 
0.1029 
-0.1054 
-0.0568 
0.1813 
0.0919 
0.0510 
0.2450 
-0.1087 
0.1424 


=3 


-0.1780 
0.1520 
0.1212 
0.0213 
0.3460 
-0.0552 
-0.1532 
-0.1753 
0.0434 
0.2366 
-0.1639 
-0.1484 
-0.2574 
-0.0556 
0.0470 
-0.0907 
-0.0227 
0.2099 
0.1617 
-0.01S6 


OO 


CO c 

^ 3 » S » S 

p ^ p p ^ c 
e> ^ e» e» e» c: 


-0.0724 
-0.0432 
0.4526 
0.0344 
0.0876 
0.1732 
-0.0371 
-0.2035 
0.2570 
0.0600 
0.0863 
-0.0089 
-0.3153 
0.0778 


3 


0.2347 
0.0728 
-0.0553 
0.2837 1 
0.0597 
0.1865 
-0.0714 
0.1378 
0.1535 
-0.1971 
-0.1665 
-0.2826 
0.3554 
0.1323 
0.1657 
-0.1250 
0.1949 
0.3190 
0.1700 
0.2719 




^ i/> (A r>« f— 1 Q 
«o M lA e ^ 8 

S 8 8 ^ ^ S 

^ e> e> e> e> c: 


0.2989 
0.1494 
0.0427 
0.0895 
-0.3930 
-0.1725 
0.1841 
J.2106 
0.2036 
0.2008 
0.0535 
0.0181 
-0.2557 
-0.6681 




0JZ367 
0.3289 
0.0034 
-0.0124 
-0.1009 
0.2788 
-0.3257 
0.0120 
0.0105 
0.1917 
0.1114 
0.4971 
0J2472 
-0.1301 
-0.3004 
-0.3780 
0.0042 
0.4504 
-0.1686 
-0.4982 




0.5205 
-0J2312 

0.5082 
-0.0406 

0.3205 
-0 0670 


-0.0371 
-0.4760 
-0.0721 
-0.1648 
-0.2584 
0.3093 
0J2439 
0.4825 
-0.1461 
0.2542 
-0.8010 
0.1014 
-0.0453 
0.1861 


S 


-0.4190 
0.6304 

-0.1645 
0.0820 

-0JZ967 


0.5152 
-0.4641 
0.4504 
0.3184 
0.5250 
0.0309 
0.4116 
0.0678 
0.2455 
0.5182 
-0.3982 
0.2192 
0.2876 
0.0644 




0.4608 

-0.3037 
0.7899 

-0.5667 
0.1298 
:.0526 

-0.3696 
0.3510 

-0.4060 
0.7878 
0.6106 

-0JZ099 
0.6415 

-0.2264 
0.7541 
0.1947 
0.2147 

-0.3313 
0.6924 

-0.2442 




-0.4189 
0.5067 

-0.1327 
0.7270 
0.7343 
08M? 


-0.5512 
0.5411 

-0.5678 
0.2378 
0.1338 
0.6323 

-0.1084 
0.7447 
0.1986 
0.6256 
0.1712 

-0.6341 

-0.3613 
0.2818 
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APPENDIX II 
EXPLANATION OF TOLERANCE LEVEL 
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Before any variable is entered during the stepwise regression procedure a test 
is made on its resulting F-value, and its "tolerance." The test on the 
F-value is to insure that the entering variable can account for at least some 
threshold proportion of the variance of the dependent variable. 

The "tolerance," on the other hand, measures the colinearity between the 
entering variable and those independent variables already in the equation. 
It is the rule for determining the impact that the entering variable will 
have on the coefficients of the independent variables already in the equation. 
It also serves the function of guarding against inverting a singular or near 
singular cross products matrix. The tolerance is a measure of the proportion 
of the variance of the entering variable that is not accounted for by the 
independent variables already in the equation (i.e., a tolerance of 1.0 indi- 
cates that the entering variable is orthogonal to the independent variables 
already in the eq»K.tion, a tolerance of 0.0 means it is an exact linear func- 
tion, and in between means there is some correlation). 



52 



REFERENCES 



Ezekiel, M. , and Fox, K. A. Methods of Correlation and Regression 
Analysis . New York: John Wiley & Sons, 1959. 

Harman, H. H. Modern Factor Analysis . Chicago: University of Chicago 
Press, 1960. 

Jones, E. R. , and DuBois, P. H. The Use of Expert Judgments in the 
Development of Flight Simulator Training Courses . AFPTRC-55-14. 1955. 

Meister, D. , Finley, D. L., and Thompson, E. A. Relationship Between 
System Design, Technician Training and Maintenance Job Performance on 
Two Autopilot Subsystems . AFHRL-TR-70-20, September 1971 . 

Smith, R. L. , and Westland, R. A. Status of Maintainability Models : 
A Critical Review . AMRL-TR-70-97, March 1971. 

Topmiller, D. A. A Factor Analytic Approach to Human Engineering ^ tnalysi s 
and Prediction of System Maintainability . AMRL-TR-64-ll5, December 1954." 

U. S. Air Force. Air Force Systems Command, Design Handbook : -8. AFSC 
DH 1-8, ASD/ENZH, Wright-Patterson AFB, Ohio, 10 November 1970." ' 

U. S. Air Force. Air Force Systems Command, Design Hapdbc.k 1-9 . AFSC 
DH 1-9, ASD/ENZH, Wright-Patterson AFB, Ohio,"TSDecember 1970. 



53 



TABLE XXII 



VARIABLE 
NUMBER 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 



13 
14 

15 

U 

17 

18 

19 

20 
21 
22 

23 
24 
25 
26 

27 
28 

29 
30 

31 

32 

33 
34 

35 

36 

37 
38 

39 

40 

41 

42 
43 



DESCRIPTION OF VARIABLE 



AQE ELECTRONICS SCORE 
PAST EXPERIENCE (MONTHS) 
PAST TRAINING (MONTHS) 
PERFORMANCE TME (SECONOS) 
T.O. TIME (SECONDS) 
NUMBER OF ERRORS 
TRAINING TIME (HOURS) 

CHANUTE (AT CHANUTE= 1, NOT CHANUTE= 0) 
KEESLER (AT KEESLER= 1. NOT KEESLER= 0) 
LOWRY (AT LOWRY = 1; NOT LOWRY = 0) 
COMPLETENESS OF T.O. CHECKOUT INFORMATION 

(RATING ON 10-POlNT SCALE) 
EXTENT TO WHICH T.O. USES STANDARD SYMBOLOGY 

(10-POINT RATING SCALE) 
NUMBER OF STEPS IN CHECKOUT PROCEDURE 
NUMBER OF PIECES OF TEST EQUIPMENT NEEDED 
PERCENTAGE OF MEASUREMENTS FDR WHICH T.O. 

SPECIFIES TOLERANCES 
TEST POINTS ARE CONVENIENT OO-POINT RATING SCALE) 
T.O. SECTIONS ARE IN LOGICAL SEQUENCE (10-POINT 

RATING SCALE) 
NUMBER OF OTHER UNITS REQUIRED FDR CHECKOUT 
PERCENTAGE OF MEASUREMENTS WHICH ARE SPECIFIED 

QUANTITATIVELY IN THE T.D. (VS GO-NO GO) 
PERCENTAGE OF PLUG*IN CIRCUITS (VS HARDWIRED) 
NUMBER OF STEPS IN TROUBLE SHOOTING 
CONTROLS ARE CLEARLY IDENTIFIED (10-POINT RATING 

SCALE) 

ACCESSIBILITY OF COMPONENTS (10-POINT RATING SCALE) 
NUMBER OF TEST <^INTS 
PERCENTAGE OF IDCNTICAL CIRCUITS USED 
PERCENTAGE OF CONNECTORS WHICH CAN BE 

INCORRECTLY CONNECTED (RATING SCALE) 
NUMBER OF ADJUSTMENTS REQUIRED 
T.D. CHANGE DATA ARE CLEARLY PRESENTED (10-POINT 

RATING SCALE) 
RELIABILITY OF TEST EQUIPMENT (10-PDINT RATING SCALE) 
NUMBER OF SPECIAL CONDITIONS REQUIRED FDR CHECKOUT 

(LG. CODLING. HYDRAUUCS) 
COMPLEXITY OF TEST EQUIPMENT OPERATION (10-POINT 

RATING SCALE) 
COMPONENTS CAN STAND REPEATED ADJUSTMENT (10-POINT 

RATING SCALE) 
PERCENTAGE OF CHECKOUT WHICH IS BIT 
PERCENTAGE OF CHECKOUT WHICH IS AUTOMATICALLY 

SEQUENCED 

PERCENTAGE OF TEST EQUIPMENT READINGS WHICH 
ARE QUANTITATIVE 

CONVENIENCE OF LOCATION OF SYSTEM AND TEST EQUIP- 
MENT CONTROLS (10-POINT RATING SCALE) 

PERCENTAGE OF CHECKOUT WHICH 1$ TO LOWEST LRU 

ACCESSIBILITY OF UNITS FDR TESTING AND REMOVAL 
(lO^NT RATING SCALE) 

TEST POINT ARRANGEMENT FOLLOWS T.D. SEQUENCE 
(10-POINT RATING SCALE) 

ALTERNATE FDR VARIABLE NO. 31; COUNT OF NUMBER OF 
CONTROLS AND DISPLAYS 

ALTERNATE FDR VARIABLE NO. 16: PERCENTAGE OF TEST 
POINTS ACCESSIBLE WITHOUT REMOVING UNITS OR COVERS 

PERFORMANCE OBSERVATION WEEK 

TEST EQUIPMENT COST. DOLLARS 



FACTOR 


NAME 


"l 


LENGTH OF CHECKOUT PROCEDURE 


U2 


EQUIPMENT COMPLEXITY 


"3 


DIFFICULTY OF CHECKOUT STEPS 


"4 


NONAUTOMATIC CHECKOUT 


"5 


DIAGNOSTIC INFORMATION 


"6 


CLARITY OF INFORMATION 



ERIC 



54 



Unclassified 



Secunty CUinfication 



OOCUMENT CONTROL DATA R&D 

(Security cl»aaiHc0tion ol titl; body cl mbatfct •nd $nd»nini annoftion muat b* mnffd wht\ th» ovmrmU fport fa cf«««fn«<f) 


1 ORIGINATING ACTIVITY CC0f)p0r#<# •urtof) 

McDonnell Douglas Astronautics Company - East 
Engineering Psychology Department, St. Louis, Mo. and 
Air Force Human Resources Laboratory 

^WPAFB Davton. Ohio 


2m. REPORT SECURITY CLASSIFICATION 

Unclassified 


2b. GROUP 


RELATIONSHIP BETWEEN DESIGN CHARACTERISTICS OF AVIONICS SUBSYSTEMS AND TRAINING 
COST. TRAINING DIFFICULTY. AND JOB PERFORMANCE 


4 DESCRIPTIVE NOTES fTyp* oi fpert mnd lnclu»lv dmfa) 

Final Report, covering activity from 1 July 1971 through 1 September 1972 


9 AUTHOR(S) (Ftft nmm; middle inltlml, Immt n«m«; 

Larry M. Lintz Raymond Hopper Kenneth W. Potempa 
Susan L. Loy 


• REPORT DATE 

September 1972 


7m. TOTAL NO OF PAGES 7b. NO. OF REFS 

53 8 


M. CONT/4ACT OR GRANT NO 

F3361 5-71 -C-1 620 

b. PROJEC T NO 

1124 

Task 1124-02 

^Om. UNIT: 1124-02-04 


M. ORIGINATOR'S REPORT NUMBERfS) 

AFHRL-TR-72-70 


0b. OTHER REPORT NO(S) (Any oOft numbmn thmt uimy b* •••l^0d 

thU nport) 


Approved For Public Release, distribution unlimited 


11* SUPPLEMENTARY NOTES 


12. SPONSORING MILITARY ACTIVITY 

Advanced Systems Division, Air Force 
Human Resources Laboratory, AFSC 



The relationships between subsystem design characteristics, training cost, training 
difficulty, and job performance were investigated for avionics subsystems. A list 
of relevant design characteristics was established, based on expert opinions of 
avionics engineers. Air Force (AF) training supervisors, and AF instructors. 
Functional loops were selected from 10 subsystems representing navigation, flight 
control, communications, and fire control subsystems. Performance tests for each 
of the 30 functional loops were identified or constructed. Ten AF students per- 
formed each of the tests. Time and errors were recorded for using equipment and 
reading technical orders (T.O.'s). Both stepwise regressions and factor analysis 
were used to derive equations to predict performance time, training time, T.O. time, 
errors, and training equipment cost from equipment design characteristics, personnel 
characteristics, and environmental variables. Multiple correlation coefficients 
were 0.88 or greater. Factors of Length of Checkout Procedure, Equipment Complexity, 
Difficulty of Checkout Steps, Nonautomatic Checkout, Diagnostic Information, and 
Clarity of Information were identified. Applications of these equations should, for 
the present, be made cautiously, particularly if any of the Input data fall outside 
the ranges which entered Into derivation of the equations. 



DD ;n?vM473 



Unclassified 

Security Claiiification 



ERIC 



Unclassified 



Security Cltssificttlon 



KCy words 



Human Resources Data 
System Design 
Training Cost 
Training Time 
Maintenance Performance 



ROLK WT 



«U.S.Govtrnmant Printing Offlct: 1973 - 759-492/450 



Unclassified 



Security Claaaiflcttion 



